Information processing system, information processing method, and computer program

ABSTRACT

A first video generator generates first information for displaying, as a first video, a character object of a first user and a first object. A second video generator displays the first object and a third object different from the second object. An association portion associates the character object of the first user with a fourth object associated with the third object when the character object of the first user and the third object have a predetermined relationship. The second video generator displays the fourth object in association with the character object of the first user when the fourth object is associated with the character object of the first user by the association portion.

This application claims the benefit of priority from Japanese PatentApplication Nos. 2021-177158 filed Oct. 29, 2021 and 2021-177159 filedOct. 29, 2021, 2021-177160 filed Oct. 29, 2021 and 2021-206823 filedDec. 21, 2021, the entire contents of the prior applications beingincorporated herein by reference.

TECHNICAL FIELD

This disclosure relates to an information processing system, aninformation processing method, and a computer program.

BACKGROUND TECHNOLOGY

An information processing system is known that generates an animation ofa character object based on the movement of an actor and distributes avideo including the animation of the character object.

SUMMARY Problem to Be Resolved

In this technical field, how to improve distributing users’ distributionmotivation, viewing users’ viewing motivation, and/or users’ motivationto interact with each other are important problems.

Therefore, an object of this disclosure is to provide technicalimprovements that solve or alleviate at least some of the problems ofthe prior art. One of the more specific objectives of this disclosure isto provide an information processing system, an information processingmethod, and a computer program that can improve the distributing users’distribution motivation, the viewing users’ viewing motivation and/orthe users’ motivation to interact with each other.

Means of Solving Problem

An information processing system comprises one or more computerprocessors, the one or more computer processors comprising: atransmitter that transmits, to a second user terminal of a second user,information about a video including a character object of a first user;a movement operation receiver that accepts a movement operation of thecharacter object of the first user in a virtual space; a virtual cameracontroller that accepts a camera operation of a virtual camera thatcaptures in the virtual space; and a video generator that generatesinformation for making the character object of the first user movable inthe virtual space based on the movement operation and the cameraoperation, wherein: a first movement operation is applied to thecharacter object of the first user in response to a predeterminedoperation with respect to a first operation UI displayed at a first userterminal of the first user; a second movement operation is applied tothe character object of the first user in response to a predeterminedoperation with respect to a second operation UI displayed at the firstuser terminal; a viewpoint of the virtual camera is switched to afirst-person viewpoint or a third-person viewpoint in response to apredetermined operation with respect to a third operation UI displayedat the first user terminal; and movement, rotation and/or scaleoperations of the virtual camera are applied in response to apredetermined operation with respect to a region where the firstoperation UI, the second operation UI, and the third operation UI arenot displayed, at the first user terminal.

The information processing system as above, wherein the one or morecomputer processors switch whether or not to display a comment on thevideo displayed on the first user terminal in response to apredetermined operation with respect to the first user terminal; and/orwhen the one or more computer processors switch whether or not todisplay a comment on the video, the one or more computer processorschange display positions of the first operation UI and the secondoperation UI, or place the first operation UI, the second operation UIand the third operation UI in a non-display state.

The information processing system as above, wherein the first movementoperation is a horizontal movement, and the second movement operation isa vertical movement; and/or the one or more computer processors apply arotation operation to the virtual camera in response to a one-fingerswipe operation with respect to the region; apply a movement operationto the virtual camera in response to a two-finger swipe operation withrespect to the region; and apply a scale operation to the virtual camerain response to a two-finger pinch-in/pinch-out operation with respect tothe region.

The information processing system as above, wherein the virtual cameracontroller accepts a camera operation from the first user or a userauthorized by the first user.

The information processing system as above, wherein a movement of a faceof the character object of the first user is generated based on amovement of a face of the first user captured by a front camera of thefirst user terminal; and the video generator generates the movement ofthe face of the character object of the first user in an inverted stateor a non-inverted state according to a positional relationship betweenthe character object of the first user and the virtual camera.

The information processing system as above, wherein when the characterobject of the first user moves beyond a movable region, the videogenerator causes the character object to reappear from another positionin the virtual space.

An information processing method that causes one or more computerprocessors to execute: a transmission step that transmits, to a seconduser terminal of a second user, information about a video including acharacter object of a first user; a movement operation reception stepthat accepts a movement operation of the character object of the firstuser in a virtual space; a virtual camera control step that accepts acamera operation of a virtual camera that captures in the virtual space;and a video generation step that generates information for making thecharacter object of the first user movable in the virtual space based onthe movement operation and the camera operation, wherein the videogeneration step applies a first movement operation to the characterobject of the first user in response to a predetermined operation withrespect to a first operation UI displayed at a first user terminal ofthe first user; applies a second movement operation to the characterobject of the first user in response to a predetermined operation withrespect to a second operation UI displayed at the first user terminal;switches a viewpoint of the virtual camera to a first-person viewpointor a third-person viewpoint in response to a predetermined operation fora third operation UI displayed at the first user terminal; and appliesmovement, rotation and/or scale operations of the virtual camera inresponse to a predetermined operation with respect to a region where thefirst operation UI, the second operation UI, and the third operation UIare not displayed, at the first user terminal.

An information processing method that causes one or more computerprocessors to execute: a transmission step that transmits, to a serverdevice, information about a video including a character object of afirst user; a movement operation reception step that accepts a movementoperation of the character object of the first user in a virtual space;a virtual camera control step that accepts a camera operation of avirtual camera that captures in the virtual space; and a videogeneration step that generates information for making the characterobject of the first user movable in the virtual space based on themovement operation and the camera operation, wherein the videogeneration step applies a first movement operation to the characterobject of the first user in response to a predetermined operation withrespect to a first operation UI displayed at a first user terminal ofthe first user; applies a second movement operation to the characterobject of the first user in response to a predetermined operation withrespect to a second operation UI displayed at the first user terminal;switches a viewpoint of the virtual camera to a first-person viewpointor a third-person viewpoint in response to a predetermined operation fora third operation UI displayed at the first user terminal; and appliesmovement, rotation and/or scale operations of the virtual camera inresponse to a predetermined operation with respect to a region where thefirst operation UI, the second operation UI, and the third operation UIare not displayed, at the first user terminal.

A computer program that causes one or more computer processors toexecute: a transmission function that transmits, to a server device,information about a video including a character object of a first user;a movement operation reception function that accepts a movementoperation of the character object of the first user in a virtual space;a virtual camera control function that accepts a camera operation of avirtual camera that captures in the virtual space; and a videogeneration function that generates information for making the characterobject of the first user movable in the virtual space based on themovement operation and the camera operation, wherein the videogeneration function applies a first movement operation to the characterobject of the first user in response to a predetermined operation withrespect to a first operation UI displayed at a first user terminal ofthe first user; applies a second movement operation to the characterobject of the first user in response to a predetermined operation withrespect to a second operation UI displayed at the first user terminal;switches a viewpoint of the virtual camera to a first-person viewpointor a third-person viewpoint in response to a predetermined operation fora third operation UI displayed at the first user terminal; and appliesmovement, rotation and/or scale operations of the virtual camera inresponse to a predetermined operation with respect to a region where thefirst operation UI, the second operation UI, and the third operation UIare not displayed, at the first user terminal.

An information processing method that causes one or more computerprocessors to execute: a reception step that receives, from a serverdevice, information about a video including a character object of afirst user and a character object of a second user; a movement operationreception step that accepts a movement operation of the character objectof the first user in a virtual space; a virtual camera control step thataccepts a camera operation of a virtual camera that captures in thevirtual space; a transmission step that transmits, to the server device,information about the movement operation and the camera operation; and adisplay step that displays the character object of the first user andthe character object of the second user so as to be movable in thevirtual space, wherein a first movement operation is applied to thecharacter object of the second user in response to a predeterminedoperation with respect to a first operation UI displayed at a seconduser terminal of the second user; a second movement operation is appliedto the character object of the first user in response to a predeterminedoperation with respect to a second operation UI displayed at the seconduser terminal; a viewpoint of the virtual camera is switched to afirst-person viewpoint or a third-person viewpoint in response to apredetermined operation with respect to a third operation UI displayedat the second user terminal; and movement, rotation and/or scaleoperations of the virtual camera are applied in response to apredetermined operation with respect to a region where the firstoperation UI, the second operation UI, and the third operation UI arenot displayed, at the second user terminal.

A computer program that causes one or more computer processors torealize: a reception function that receives, from a server device,information about a video including a character object of a first userand a character object of a second user; a movement operation receptionfunction that accepts a movement operation of the character object ofthe second user in a virtual space; a virtual camera control functionthat accepts a camera operation of a virtual camera that captures in thevirtual space; a transmission function that transmits, to the serverdevice, information about the movement operation and the cameraoperation; and a display function that displays the character object ofthe first user and the character object of the second user so as to bemovable in the virtual space, wherein a first movement operation isapplied to the character object of the second user in response to apredetermined operation with respect to a first operation UI displayedat a second user terminal of the second user; a second movementoperation is applied to the character object of the first user inresponse to a predetermined operation with respect to a second operationUI displayed at the second user terminal; a viewpoint of the virtualcamera is switched to a first-person viewpoint or a third-personviewpoint in response to a predetermined operation with respect to athird operation UI displayed at the second user terminal; and movement,rotation and/or scale operations of the virtual camera are applied inresponse to a predetermined operation with respect to a region where thefirst operation UI, the second operation UI, and the third operation UIare not displayed, at the second user terminal.

An information processing system comprises one or more computerprocessors, the one or more computer processors comprising: atransmitter that transmits, to a second user terminal of a second user,information about a video including a character object of a first user;a movement operation receiver that accepts a movement operation of thecharacter object of the first user in a virtual space; a virtual cameracontroller that accepts a camera operation of a virtual camera thatcaptures in the virtual space; and a video generator that generatesinformation for making the character object of the first user movable inthe virtual space based on the movement operation and the cameraoperation, wherein the video generator can further generate informationfor displaying, in the video, a character object of one or more otherusers; and the transmitter transmits, to the second user terminal,information about a video of a first-person viewpoint or a third-personviewpoint of the character object of the first user; a video of afirst-person viewpoint or a third-person viewpoint of a character objectof one other user from among the one or more other users; or a pluralityof videos of (i) the first-person viewpoint or the third-personviewpoint of the character object of the first user, and (ii) thefirst-person viewpoint or the third-person viewpoint of the characterobject of the other users.

The information processing system as above, wherein the one or morecomputer processors are provided with a selection receiver that acceptsselection of one user from among the first user and the one or moreother users, by the first user or the second user; and/or thetransmitter transmits information about the video according to theselection accepted by the selection receiver.

The information processing system as above, wherein when the selectionreceiver accepts the selection of one other user from among the one ormore other users by the first user, the transmitter transmitsinformation about the first-person video of the other user; and/or theone or more computer processors further comprise: a production receiverthat accepts a request from another user to display a production effectin the video; and an effect generator that generates a production effectin the video in response to the display request accepted by theproduction receiver, wherein when the selection receiver accepts theselection of one other user from among the one or more other users bythe first user, the transmitter transmits information about the video inwhich the production effect has been generated.

The information processing system as above, wherein the one or morecomputer processors further comprise: a switching receiver that acceptsa request for switching an object to the video from the other user,wherein when the selection receiver accepts the selection of one otheruser from among the one or more other users by the first user, the videogenerator changes an object other than the character object of the firstuser and the character object of the second user displayed in thevirtual space to another object in response to the switching requestreceived by the switching receiver; and/or movement of a face of thecharacter object of the first user is generated based on movement of aface of the first user captured by a front camera of a first userterminal of the first user; and the video generator generates themovement of the face of the character object of the first user in aninverted state or a non-inverted state according to a positionalrelationship between the character object of the first user and thevirtual camera; and/or when the character object of the first user movesbeyond a movable region, the video generator causes the character objectto reappear from another position in the virtual space.

An information processing method that causes one or more computerprocessors to execute: a transmission step that transmits, to a seconduser terminal of a second user, information about a video including acharacter object of a first user; a movement operation reception stepthat accepts a movement operation of the character object of the firstuser in a virtual space; a virtual camera control step that accepts acamera operation of a virtual camera that captures in the virtual space;and a video generation step that generates information for making thecharacter object of the first user movable in the virtual space based onthe movement operation and the camera operation, wherein: the videogeneration step can further generate information for displaying, in thevideo, a character object of one or more other users; and thetransmission step transmits, to the second user terminal, informationabout a video of a first-person viewpoint or a third-person viewpoint ofthe character object of the first user; a video of a first-personviewpoint or a third-person viewpoint of a character object of one otheruser from among the one or more other users; or a plurality of videos of(i) the first-person viewpoint or the third-person viewpoint of thecharacter object of the first user, and (ii) the first-person viewpointor the third-person viewpoint of the character object of the otherusers.

An information processing method that causes one or more computerprocessors to execute: a transmission step that transmits, to a serverdevice, information about a video including a character object of afirst user; a movement operation reception step that accepts a movementoperation of the character object of the first user in a virtual space;a virtual camera control step that accepts a camera operation of avirtual camera that captures in the virtual space; a video generationstep that generates information for making the character object of thefirst user movable in the virtual space based on the movement operationand the camera operation; a reception step that receives, from theserver device, information for displaying the character object of one ormore other users in the video; and a display step that displays (i) avideo of a first-person viewpoint or a third-person viewpoint of thecharacter object of the first user, (ii) a video of the first-personviewpoint or the third-person viewpoint of the character object of oneother user from among one or more of the other users, or (iii) aplurality of videos of (a) the first-person viewpoint or thethird-person viewpoint of the character object of the first user, and(b) the first-person viewpoint or the third-person viewpoint of thecharacter object of the other users.

A computer program that causes one or more computer processors torealize: a transmission function that transmits, to a server device,information about a video including a character object of a first user;a movement operation reception function that accepts a movementoperation of the character object of the first user in a virtual space;a virtual camera control function that accepts a camera operation of avirtual camera that captures in the virtual space; a video generationfunction that generates information for making the character object ofthe first user movable in the virtual space based on the movementoperation and the camera operation; a reception function that receives,from the server device, information for displaying the character objectof one or more other users in the video; and a display function thatdisplays (i) a video of a first-person viewpoint or a third-personviewpoint of the character object of the first user, (ii) a video of thefirst-person viewpoint or the third-person viewpoint of the characterobject of one other user from among one or more of the other users, or(iii) a plurality of videos of (a) the first-person viewpoint or thethird-person viewpoint of the character object of the first user, and(b) the first-person viewpoint or the third-person viewpoint of thecharacter object of the other users.

An information processing method that causes one or more computerprocessors to execute: a reception step that receives, from a serverdevice, information about a video including a character object of afirst user and a character object of a second user; a movement operationreception step that accepts a movement operation of the character objectof the first user in a virtual space; a virtual camera control step thataccepts a camera operation of a virtual camera that captures in thevirtual space; a transmission step that transmits, to the server device,information about the movement operation and the camera operation; and adisplay step that displays the character object of the first user andthe character object of the second user so as to be movable in thevirtual space, wherein: the display step displays (i) a video of afirst-person viewpoint or a third-person viewpoint of the characterobject of the first user, (ii) a video of the first-person viewpoint orthe third-person viewpoint of the character object of the second user,or (iii) a plurality of videos of (a) the first-person viewpoint or thethird-person viewpoint of the character object of the first user, and(b) the first-person viewpoint or the third-person viewpoint of thecharacter object of the second user.

A computer program that causes one or more computer processors torealize: a reception function that receives, from a server device,information about a video including a character object of a first userand a character object of a second user; a movement operation receptionfunction that accepts a movement operation of the character object ofthe second user in a virtual space; a virtual camera control functionthat accepts a camera operation of a virtual camera that captures in thevirtual space; a transmission function that transmits, to the serverdevice, information about the movement operation and the cameraoperation; and a display function that displays the character object ofthe first user and the character object of the second user so as to bemovable in the virtual space, wherein the display function displays (i)a video of a first-person viewpoint or a third-person viewpoint of thecharacter object of the first user, (ii) a video of the first-personviewpoint or the third-person viewpoint of the character object of thesecond user, or (iii) a plurality of videos of (a) the first-personviewpoint or the third-person viewpoint of the character object of thefirst user, and (b) the first-person viewpoint or the third-personviewpoint of the character object of the second user.

Effects

According to this disclosure, technical improvements that solve oralleviate at least some of the problems of the prior art described abovecan be provided. Specifically, according to this disclosure, thedistributing users’ distribution motivation, the viewing users’ viewingmotivation and/or the users’ motivation to interact with each other canbe improved.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a system configuration diagram showing an example of aninformation processing system in this disclosure.

FIG. 2 is a system configuration diagram showing an example of aninformation processing system in this disclosure.

FIG. 3 is a system configuration diagram showing an example of aninformation processing system in this disclosure.

FIG. 4 is a configuration diagram showing an example of a hardwareconfiguration of a server device, a first user terminal and a seconduser terminal in this disclosure.

FIG. 5 is a conceptual diagram showing an image of a screen displayed ona user terminal.

FIG. 6 is a conceptual diagram showing an image of a screen displayed ona user terminal.

FIG. 7 is a conceptual diagram showing an image of a screen displayed ona user terminal.

FIG. 8 is a conceptual diagram showing an image of a screen displayed ona user terminal.

FIG. 9 is a conceptual diagram showing an image of a screen displayed ona user terminal.

FIG. 10 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 11 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 12 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 13 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 14 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 15 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 16 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 17 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 18 is a configuration diagram showing an example of a functionalconfiguration of a server device according to a first embodiment of thisdisclosure.

FIG. 19 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 20 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 21 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 22 is a conceptual diagram showing an image of a virtual space inthis disclosure.

FIG. 23 is a conceptual diagram showing an image of a virtual space inthis disclosure.

FIG. 24 is a conceptual diagram showing an image of a virtual space inthis disclosure.

FIG. 25 is a conceptual diagram showing an image of a virtual space inthis disclosure.

FIG. 26 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 27 is a conceptual diagram showing an image of a virtual space inthis disclosure.

FIG. 28 is a configuration diagram showing another example of thefunctional configuration of the server device according to the firstembodiment of this disclosure.

FIG. 29 is a configuration diagram showing an example of a functionalconfiguration of a server device according to a second embodiment ofthis disclosure.

FIG. 30 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 31 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 32 is a configuration diagram showing another example of thefunctional configuration of the server device according to the secondembodiment of this disclosure.

FIG. 33 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 34 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 35 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 36 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 37 is a configuration diagram showing an example of a functionalconfiguration of a server device according to a third embodiment of thisdisclosure.

FIG. 38 is a conceptual diagram showing an image of a virtual space inthis disclosure.

FIG. 39 is a conceptual diagram showing images of a third object and afourth object in this disclosure.

FIG. 40 is a conceptual diagram showing an image of a loading image inthis disclosure.

FIG. 41 is a configuration diagram showing another example of thefunctional configuration of the server device according to the thirdembodiment of this disclosure.

FIG. 42 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 43 is a flowchart showing an example of a processing flow in thisdisclosure.

FIG. 44 is a flowchart showing an example of a processing flow in thisdisclosure.

FIG. 45 is a conceptual diagram showing an image of a fifth object inthis disclosure.

FIG. 46 is a configuration diagram showing an example of a functionalconfiguration of a first user terminal according to a fourth embodimentof this disclosure.

FIG. 47 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 48 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 49 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 50 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 51 is a configuration diagram showing an example of a functionalconfiguration of a first user terminal according to a fifth embodimentof this disclosure.

FIG. 52 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 53 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 54 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 55 is a configuration diagram showing another example of thefunctional configuration of the first user terminal according to thefifth embodiment of this disclosure.

FIG. 56 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 57 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 58 is a conceptual diagram showing an image of a screen displayedon a user terminal.

FIG. 59 is a flowchart showing an example of a flow of an informationprocessing method in this disclosure.

FIG. 60 is a circuit configuration diagram showing an example of acircuit configuration for realizing a computer program in thisdisclosure.

FIG. 61 is a configuration diagram showing an example of a functionalconfiguration of the first user terminal in this disclosure.

FIG. 62 is a flow chart showing an example of a flow of an informationprocessing method in the first user terminal in this disclosure.

FIG. 63 is a circuit configuration diagram showing an example of acircuit configuration for realizing a computer program executed by thefirst user terminal in this disclosure.

FIG. 64 is a configuration diagram showing an example of the functionalconfiguration of the second user terminal in this disclosure.

FIG. 65 is a flow chart showing an example of a flow of an informationprocessing method in the second user terminal in this disclosure.

FIG. 66 is a circuit configuration diagram showing an example of acircuit configuration for realizing a computer program executed by thesecond user terminal in this disclosure.

FIG. 67 is a flowchart showing an example of a flow of an informationprocessing method in this disclosure.

FIG. 68 is a circuit configuration diagram showing an example of acircuit configuration for realizing a computer program in thisdisclosure.

FIG. 69 is a flowchart showing an example of a flow of an informationprocessing method in the first user terminal in this disclosure.

FIG. 70 is a circuit configuration diagram showing an example of acircuit configuration for realizing a computer program executed by thefirst user terminal in this disclosure.

FIG. 71 is a configuration diagram showing an example of a functionalconfiguration of the second user terminal in this disclosure.

FIG. 72 is a flowchart showing an example of a flow of an informationprocessing method in the second user terminal in this disclosure.

FIG. 73 is a circuit configuration diagram showing an example of acircuit configuration for realizing a computer program executed by thesecond user terminal in this disclosure.

FIG. 74 is a flowchart showing an example of a flow of an informationprocessing method in this disclosure.

FIG. 75 is a circuit configuration diagram showing an example of acircuit configuration for realizing a computer program in thisdisclosure.

FIG. 76 is a configuration diagram showing an example of a functionalconfiguration of the first user terminal in this disclosure.

FIG. 77 is a flowchart showing an example of a flow of an informationprocessing method in the first user terminal in this disclosure.

FIG. 78 is a circuit configuration diagram showing an example of acircuit configuration for realizing a computer program executed by thefirst user terminal in this disclosure.

FIG. 79 is a configuration diagram showing an example of a functionalconfiguration of a second user terminal in this disclosure.

FIG. 80 is a flowchart showing an example of a flow of an informationprocessing method in the second user terminal in this disclosure.

FIG. 81 is a circuit configuration diagram showing an example of acircuit configuration for realizing a computer program executed by thesecond user terminal in this disclosure.

MODE TO IMPLEMENT EMBODIMENTS

First, an overview of an information processing system according to anembodiment of this disclosure will be described with reference to thedrawings.

The information processing system in this disclosure is an informationprocessing system including one or more information processing devicesand a server device, and includes one or more computer processors.

A video displayed on each device is described as including, but is notlimited to, an animation of a character object generated based on themovement of the distributing user. The video may include an animation ofa character object generated in response to an operation of thedistributing user, or may include an image of the distributing userhimself/herself. The video may also include only the voice of thedistributing user, without displaying a character object or thedistributing user.

The space displayed in the video may be a virtual space, a realityspace, or an augmented reality space that is a combination thereof. Thevideo may be something like a karaoke video or a live game video thatplays at least a predetermined image and the voice of the distributinguser, or it may be a superimposed display of a character object, or areal image of the distributing user, on these images.

Further, when the distributing user is included in the reality space,the character object generated based on the movement of the distributinguser may be superimposed and displayed on the actual image of thedistributing user. Further, an animation such as a gift object may besuperimposed and displayed on the captured image in the reality space.

The information processing system in an embodiment of this disclosurecan be used to provide the next Internet space (metaverse), which is adigital world in which many people can participate simultaneously andfreely engage in activities such as interaction, work, and play viacharacter objects (avatars) at a level close to that of the real world.Social activities can be carried out transcending the gap betweenreality and virtuality.

In this embodiment, as one element of the above metaverse, theinformation processing system can be used to realize a “world function”in which people’s avatars (character objects) can freely walk around ina virtual space and communicate with each other.

System Configuration

As shown as an example in FIG. 1 , an information processing system 1000according to this disclosure includes (i) one or more viewing userterminals 1100, and (ii) an information processing device (supportcomputer) 1300 arranged in a video distribution studio or the like,which is connected to these viewing user terminals 1100 via a network1200.

Further, the information processing device 1300 may be connected to aserver device via the Internet, and part or all of the processing to beperformed by the information processing device 1300 may be performed bythe server device. The server device may be an information processingdevice 2400 shown in FIG. 2 .

In this specification, the distribution by the information processingsystem 1000 is referred to as studio distribution.

In studio distribution, movement of an entire body of a distributinguser (actor) will be reflected in a character in real time by capturingmarkers attached to the distributing user with a camera(s) installed inthe studio and using known motion capture technology.

Additionally, the information processing system 1000 can also work withanother information processing system 2000, shown in FIG. 2 as anexample. The information processing system 2000 shown in FIG. 2 caninclude (i) a distributing user terminal 2100, (ii) one or more viewinguser terminals 2200, and (iii) and the information processing device(server device) 2400 that is connected to the distributing user terminal2100 and the viewing user terminals 2200 via a network 2300.

In the above example, the distributing user terminal 2100 can be aninformation processing terminal such as a smartphone. In thisspecification, distribution by such information processing system 2000is referred to as mobile distribution.

In mobile distribution, the movement of the distributing user’s face iscaptured by a camera provided in the distributing user terminal 2100 andreflected on the character’s face in real time using known face trackingtechnology.

There is no particular distinction between a distributing user and aviewing user in mobile distribution. A viewing user can perform mobiledistribution at any time, and the distributing user can be a viewinguser when viewing a video of another distributing user.

The video generated by the information processing system 1000 and theinformation processing system 2000 can be distributed to a viewing userfrom one video distribution platform as an example.

Furthermore, in any distribution, the process of generating animation byreflecting motion to the character, the process of displaying a giftdescribed below, and the like may be shared by a distributing userterminal, a viewing user terminal, an information processing device andother devices.

That is, “distribution” here refers to transmitting information to makethe video available for viewing at the viewing user terminal. Videorendering is performed at the information processing devices 1300, 2400side or at the distributing user terminal 2100 and viewing user terminal1100 and 2200 side.

Specifically, face motion data and voice data of the distributing useris transmitted from the distributing user terminal or informationprocessing device to the terminal or device that generates (renders) theanimation of the character object. Further, a body motion may betransmitted in addition to the face motion.

In this disclosure, the process of generating an animation will bedescribed as being performed by each of the distributing user terminaland the viewing user terminal, but this disclosure is not limited tothis.

The information processing system in this disclosure can be applied toany of the examples shown in FIGS. 1 and 2 . Further, since it is notalways necessary to distinguish between the “distributing user” and the“viewing user”, an information processing system 3000 in the embodimentof this disclosure is described as shown in FIG. 3 , with a first userterminal 100, second user terminals 200, and a server device 400 thatcan be connected to these first user terminal 100 and second userterminals 200 via a network 300.

The first user terminal 100 functions as at least the informationprocessing device 1300 or distributed user terminal 2100 describedabove. The second user terminals 200 function as at least one or moreviewing user terminals 1100, 2200 described above. The server device 400functions as at least the server device or information processing device2400 described above.

In this disclosure, the first user terminal 100 and the second userterminals 200 may each be a smartphone (multi-functional phoneterminal), a tablet terminal, a personal computer, a console gamemachine, a head-mounted display (HMD), a wearable computer such as aspectacle-type wearable terminal (AR glasses or the like), and aninformation processing device other than these devices that canreproduce a video. Further, these terminals may be stand-alone devicesthat operate independently, or may be constituted by a plurality ofdevices that are connected to each other so as to be able to send andreceive various data.

Hardware Configuration

Here, a hardware configuration of the first user terminal 100 will bedescribed with reference to FIG. 4 . The first user terminal 100includes a processor 101, a memory 102, a storage 103, an input/outputinterface (I/O I/F) 104, and a communication interface (communicationI/F) 105. Each component is connected to each other via a bus B.

The first user terminal 100 can realize the functions and methodsdescribed in this embodiment by the processor 101, the memory 102, thestorage 103, the I/O I/F 104, and the communication I/F 105 workingtogether.

The processor 101 executes a function and/or a method realized by a codeor a command included in a program stored in the storage 103. Theprocessor 101 may realize each process disclosed in each embodiment by alogic circuit (hardware) chip or a dedicated circuit formed in anintegrated circuit (IC (Integrated Circuit) chip, an LSI (Large ScaleIntegration)) or the like, including, for example, a CPU (CentralProcessing Unit), a MPU (Micro Processing Unit), a GPU (GraphicsProcessing Unit), a microprocessor, a processor core, a multiprocessor,an ASIC (Application-Specific Integrated Circuit), an FPGA (FieldProgrammable Gate Array), and the like. These circuits may be realizedby one or more integrated circuits. A plurality of processes shown ineach embodiment may be realized by a single integrated circuit.Furthermore, LSI may also be referred to as a VLSI, a Super LSI, a UltraLSI, and the like, depending on the degree of integration.

The memory 102 temporarily stores a program loaded from the storage 103and provides a work region to the processor 101. Various data generatedwhile the processor 101 is executing the program are also temporarilystored in the memory 102. The memory 102 includes, for example, a RAM(Random Access Memory), a ROM (Read Only Memory), and the like.

The storage 103 stores the program. The storage 103 includes, forexample, an HDD (Hard Disk Drive), an SSD (Solid State Drive), a flashmemory, and the like.

The communication I/F 105 is implemented as hardware such as a networkadapter, software for communication, and a combination thereof, and isused to send and receive various types of data via the network 300. Thiscommunication may be executed by either by wire or wirelessly, and anycommunication protocol may be used as long as mutual communication canbe executed. The communication I/F 105 executes communication withanother information processing device via the network 300. Thecommunication I/F 105 transmits various data to other informationprocessing devices according to instructions from the processor 101. Thecommunication I/F 105 also receives various data transmitted from otherinformation processing devices and transmits them to the processor 101.

The input/output I/F 104 includes an input device for inputting variousoperations to the first user terminal 100 and an output device foroutputting processing results processed by the first user terminal 100.The input/output I/F 104 may such that the input device and the outputdevice are integrated, or may be separated into the input device and theoutput device.

The input device is realized by any one of all types of devices that canreceive an input from a user and transmit information related to theinput to the processor 101, or a combination thereof. The input deviceincludes, for example, (i) a hardware key, such as a touch panel, atouch display, and a keyboard, (ii) a pointing device, such as a mouse,(iii) a camera (operation input via an image), and (iv) a microphone(operation input by voice).

The input device may include a sensor portion. The sensor portion is oneor more sensors that detect (i) face motion, which indicates changes inthe user’s facial expression, and (ii) body motion, which indicateschanges in the relative position of the user’s body with respect to thesensor portion. Face motion includes movements such as blinking of theeyes, opening and closing of the mouth, or the like. The sensor portionmay use any known object. An example of a sensor portion includes (i) aToF sensor that measures and detects the time of flight (Time of Flight)until light irradiated toward the user is reflected by the user’s faceand returns, and the like, (ii) a camera that captures the user’s face,and (iii) an image processor that image-processes the data captured bythe camera. The sensor portion may also include an RGB camera forcapturing visible light and a near-infrared camera for capturingnear-infrared light. The RGB camera and near-infrared camera may use,for example, “True Depth” of the “iphone X (registered trademark),”“LIDER” of the “iPad Pro (registered trademark),” or other ToF sensorsin smartphones. This camera specifically projects tens of thousands ofinvisible dots of the user’s face and the like. Then, accurate face datais captured by detecting and analyzing the reflected light of the dotpattern to form a depth map of the face and capturing infrared images ofthe face and the like. An arithmetic processor of the sensor portiongenerates various types of information based on the depth map andinfrared image, and compares this information with registered referencedata to calculate the depth (distance between each point and thenear-infrared camera) and non-depth positional deviations for each pointon the face.

Further, the sensor portion may have a function of tracking not only theuser’s face, but also the hand (hand tracking). The sensor portion mayfurther include a sensor other than the above-mentioned sensors such asan acceleration sensor and a gyro sensor. The sensor portion may have aspatial mapping function of (i) recognizing an object in the real spacein which the user exists based on the detection results of the above ToFsensor and other known sensors, and (ii) mapping the recognized objectto the spatial map. Hereinafter, when the face motion detection data andthe body motion detection data are described with no particulardistinction, they are simply referred to as “tracking data.” The imageprocessor of the sensor portion may be provided with a controller thatcan be provided in the information processing system of this disclosure.

As an operation portion as an input device, a device corresponding tothe type of the user terminal can be used. An example of the operationportion is provided on a touch panel integrated with a display, anoperation button provided on a housing of a user terminal, a keyboard, amouse, a controller operated by a user, and the like. The controller mayincorporate various known sensors such as an acceleration sensor and aninertial measurement sensor (IMU: Inertial Measurement Unit) such as agyro. Furthermore, another example of the operation portion may be atracking device that identifies the movement of the user’s hand, themovement of the eyes, the movement of the head, the direction of theline of sight, and the like. In this embodiment, for example, based onthe user’s hand movements, the user’s instructions are determined andvarious operations are performed such as, starting or ending the videodistribution, evaluating messages and videos, and requesting the displayof predetermined objects (for example, the gift described below), andthe like. If the sensor portion also has an input interface functionsuch as a hand tracking function, the operation portion can be omitted.

The output device outputs the processing result processed by theprocessor 101. The output device includes, for example, a touch panel, aspeaker, and the like.

Further, the second user terminals 200 and the server device 400 in thisdisclosure may also be configured with the same hardware configurationas in FIG. 4 , unless otherwise noted.

Next, various functions that can be executed on a user terminal that hasstarted the application realized by the information processing systemaccording to the embodiment of this disclosure, and the transition ofthe displayed screen, will be explained with reference to the drawings.

FIG. 5 shows a top screen T10 displayed on a user terminal when a videodistribution/viewing application is started.

As shown in FIG. 5 , by selecting one distribution channel (adistribution slot, a distribution program, a distribution video, or thelike) from the thumbnail images of one or more recommended distributionchannels T12 listed in a recommendation tab T11 on the top screen T10,the user can view a video played on the one distribution channel.

Alternatively, the user can view the video played on the specificdistribution channel by accessing a fixed link of the specificdistribution channel. Such a fixed link can be obtained by anotification from a distributing user who is being followed, anotification of a share sent from another user, or the like.

In this way, the user who views the video is the viewing user, and theterminal for viewing the video is the second user terminal 200.

Further, as shown in FIG. 5 , a display field T13 for notification of acampaign, an event, or the like may be displayed on the top screen T10.The display field T13 of this notification can be switched to anothernotification by a slide operation.

Then, from the top screen T10, a follow tab T14, a game tab T15 fordisplaying a game category, an awaiting collaboration tab T16 fordisplaying an awaiting collaborative distribution channel, and abeginner tab T17 for displaying a beginner’s distribution channel aredisplayed. By selecting these (by switching the tabs), the top screenT10 transitions to respective different screens.

A service name display T18 and a search button T19 in the upper frame ofthe top screen T10 may be fixedly displayed on the transitiondestination screen.

Similarly, a home button T20, a message button T21, a distributionpreparation button T22, a gacha button T23, and a profile button T24 inthe lower frame of the top screen T10 may be fixedly displayed on thetransition destination screen.

A user who selects the displayed thumbnail images T12 on the top screenT10 or the like shown in FIG. 5 becomes a viewing user (second user) whoviews the video as described above, and a user who selects thedistribution preparation button T22 can become a distributing user(first user) who distributes a video.

As an example, when the distribution preparation button T22 is selectedon the top screen T10 shown in FIG. 5 , the screen transitions to anavatar setting screen D10 shown in FIG. 6 . Then, when a distributionbutton D11 is selected on the avatar setting screen D10, the screentransitions to a distribution setting screen D20 shown in FIG. 7 . Then,when a distribution start button D25 is selected on the distributionsetting screen D20, the screen transitions to an avatar distributionscreen D30 shown in FIG. 8 .

Next, details of the flow up to the start of video distribution will bedescribed.

The one or more computer processors in this disclosure may include adistribution start request receiving portion, a distribution settingportion, and a distribution start portion.

The distribution start request receiving portion receives a distributionstart request for a first video including an animation of a characterobject from the distributing user terminal of the distributing user.

Here, the first video refers to a video including an animation of acharacter object. In this specification, the character object may bereferred to as an “avatar.”

Then, the above distribution start request can be transmitted from theuser terminal to the information processing device 2400 by selecting thedistribution button D11 located on the avatar setting screen or the likethat has transitioned from the top screen displayed on the user terminal(later to become the distributing user terminal 2100) that started thededicated application (video distribution/viewing application) foraccessing the above-described video distribution platform.

FIG. 6 shows an example of the avatar setting screen D10. A characterobject CO, the distribution button D11, a gacha button D12, a change ofclothes button D13, a photo button D14, and the like can be displayed onthe avatar setting screen D10.

When the change-of-clothes button D13 is selected by the user, a closetscreen for selecting various avatar parts such as eyes, nose, mouth,hair, accessories, clothes, and background of the character object COappears.

When the gacha button D12 is selected by the user, a lottery screen forobtaining the above avatar parts appears.

When the photo button D14 is selected by the user, a capturing screenfor capturing a still image of the character object appears.

Then, when the distribution button D11 is selected by the user, adistribution start request is transmitted to the information processingdevice 2400 (server device 400).

The distribution setting portion sets the distribution setting of thefirst video based on the designation from the distributing user terminal2100 in response to the distribution start request of the first videoreceived by the distribution start request receiving portion.

As an example, when the distribution button D11 is selected, the screendisplayed on the distributing user terminal 2100 transitions from theavatar setting screen D10 shown in FIG. 6 to the distribution settingscreen D20 shown in FIG. 7 .

The distribution setting can include at least one of a setting relatedto the title of the first video, a setting regarding whether other userscan appear in the first video, a setting related to the number of peoplewho can appear in the first video, a the setting related to a password.

These distribution settings can be set in a title setting field D21, acollaboration possibility setting field D22, a number-of-people settingfield D23, and a password setting field D24 in FIG. 7 , respectively.Additionally, in FIG. 7 , a collaboration possibility setting field D26and an SNS posting possibility field D27 are further displayed.

The title of the first video can be freely determined by thedistributing user within a range of the number of characters up to anallowable upper limit. If there is no input by the distributing user, apreset title, including the name of the distributing user or characterobject such as “This is so and so’s distribution ♪,” may be determinedautomatically.

Whether other users can make a request for appearance in the first videocan be freely determined by the distributing user. If yes, other userscan make a request for appearance to the distributing user. If no, otherusers cannot make a request for appearance to the distributing user. Astate in which another user appears in the video of the distributinguser may be referred to as “collaboration” in this specification.Details of the collaboration will be described later.

The number of people who can appear in the first video can be set onlywhen other users can appear in the first video mentioned above, and thedistributing user can freely determine this number within a range of thenumber of people up to an allowable upper limit.

A password can be arbitrarily set only when other users can appear inthe first video mentioned above, and the distributing user can freelydetermine the designated number of digits. When another user makes arequest for appearance in the first video, entering of such a passwordis required. A configuration is acceptable in which the password settingfield D24 may become active only when the collaboration possibilitysetting field D26 is OFF.

The distribution start portion distributes information about the firstvideo to the viewing user terminal(s) 2200 of the viewing user(s) basedon the conditions set by the distribution setting portion.

The instruction to start such distribution is transmitted by selectingthe distribution start button D25 shown in FIG. 7 .

As an example, the distribution start portion distributes informationabout the video (first video) including the animation of the characterobject of the distributing user to the viewing user terminal 2200 of theviewing user (avatar distribution).

Information about the first video includes, for example, motioninformation indicating movement of the character object, voiceinformation of the distributing user, and gift object informationindicating a gift sent from another viewing user. The gift objectinformation includes at least gift object identification informationthat identifies the type of the gift object and position informationthat indicates the position where the gift object is displayed.

Then, the distribution start portion can live-distribute the video viathe video distribution platform described above.

FIG. 8 shows the avatar distribution screen D30 displayed on thedistributing user terminal 2100.

In addition to displaying the character object CO on the avatardistribution screen D30, a comment input button D31 for the distributinguser to input a comment, a photo button D32 for saving a still image ofthe screen, a play start button D33 for playing a game described later,an external service liaison button D34 for viewing a video provided byan external service, and the gacha button D12 for obtaining an avatarpart can be displayed.

Additionally, a cumulative number-of-viewers display D35, a cumulativenumber-of-likes display D36, a number-of-collaborators display D37, ashare button D38 for an external SNS, a guest details button D39, aranking display button D40, a setting button D41, and a voice switchingbutton D42 for switching voice ON/OF can be displayed. Further, an endbutton D43 for ending the distribution is also displayed.

Although detailed description of these displays and buttons is omitted,it is possible to change the distribution settings set on thedistribution setting screen D20 by selecting the setting button D41.

FIG. 8 shows an example of starting distribution in which thedistribution setting screen D20 allows other users to appear in thefirst video, and the number of people who can appear in the first videois three. Therefore, the character object CO is displayed in a state ofbeing closer to the lower left. Up to three character objects of otherusers are in a state of being able to appear in a vacant space.

The above is a description of the screen transition when the avatardistribution of this disclosure is performed.

Subsequently, the screen transition when the distributing user plays agame during distribution will be described.

The one or more computer processors in this disclosure may include agame request receiving portion, a game video distributor, and a gamedisplay processor.

The distributing user can request to start playing the game by selectingthe play start button D33 during the avatar distribution as shown inFIG. 8 .

The game displayed by selecting the play start button D33 is a dedicatedgame implemented in the application realized by the informationprocessing system in this disclosure, and is different from ageneral-purpose game provided by an external service. Therefore, thegame distribution in this disclosure may be distinguished from thedistribution of a general-purpose game play video provided by anexternal service together with a live broadcast of the distributinguser.

Alternatively, the play start request may be transmitted from thedistributing user terminal 2100 to the information processing device2400 by selecting the play start button arranged on a predeterminedscreen displayed on the distributing user terminal 2100 of thedistributing user.

FIG. 9 shows an example of a screen G10, in which a play start buttonG11 is arranged, as the predetermined screen. The screen G10 shown inFIG. 9 is a screen that has transitioned from the top screen T10 (FIG. 5) displayed on the user terminal that has started the applicationrealized by the information processing system in this disclosure byselecting the game tab T15.

At least the play start button G11 that can transmit a request to startplay of a predetermined game is displayed on the screen G10.

Then, when the game request receiving portion receives the request tostart play of the predetermined game, the game video distributionportion distributes the information about a second video to the viewinguser terminal.

Here, the second video is a play video of a predetermined game. In thisspecification, distributing such a video so that it is displayed on thescreen of the viewing user terminal 2200 is called “game distribution.”

Further, as a distributing user, after starting the application realizedby this disclosure, the user can transmit the request for the start ofdistribution of the second video to the information processing device2400 by selecting a play start object arranged on the game list screenand the game detail screen.

The game list screen or the game details screen is a first screen to bedescribed in detail below.

That is, the game display processor performs display processing of thefirst screen including (i) a distribution start object that can transmita distribution start request, (ii) a play start object that can transmita play start request for a predetermined game, and (iii) a thumbnailimage of a video that is distributing a play video for a predeterminedgame.

The screen G10 shown in FIG. 9 corresponds to the game list screen ofthe first screen. The first screen, which is the game list screen, is ascreen that has transitioned from the top screen T10 by selecting thegame tab T15.

The first screen includes (i) the distribution preparation button T22 asa distribution start object, (ii) the play start button G11 as a playstart object, and (iii) a thumbnail image showing a distribution channelof a video.

On the first screen, for each of a plurality of playable games, the playstart button G11, a game icon G12, game name G13, a totalnumber-of-viewers G14of the distribution channel of the game, and adistribution list G15 including thumbnail images of the distributionchannels during the game distribution are displayed.

The order of the thumbnail images displayed in the distribution list G15displayed here may be different depending on the viewing user. As anexample, the order is arranged in the order of (i) the order in whichthe number of viewing users following and the number of views by theviewing users are highest, (ii) the order in which the cumulative numberof viewers is highest, and (iii) the order in which the distributionstart is oldest. Additionally, the display range of the thumbnail imagesof the distribution list G15 can be changed by horizontal scrolling.

Additionally, the games displayed on this game list screen will read thetop 10 titles with the following priorities. As an example, the priorityis determined by (i) the order of newest date of the last play by theviewing user within 30 days within 48 hours from the game distributionstart date and time, (ii) the order of priority of a period ID, and(iii) the descending order of the period ID.

This distribution list G15 will be updated (i) when returning from thescreen of another tab and (ii) when performing a refresh operation(Pull-to-Refresh).

FIG. 10 corresponds to the game detail screen of the first screen. Thefirst screen, which is the game detail screen, is a screen that has beentransitioned by selecting the game icons G12 or the game name G13displayed on the game list screen shown in FIG. 9 , and is G20.

The first screen includes the distribution preparation button T22 whichis a distribution start object, a play start button G21 which is a playstart object, and thumbnail images showing a video distributionchannels.

Further, on the first screen, a game icon G22, a game name G23, a totalnumber-of-viewers G24 of the distribution channel of the game, and adistribution list G25 including thumbnail images of the distributionchannel being distributed in the game are displayed.

The order of the thumbnail images displayed in the distribution list G25displayed here may be different depending on the viewing user. As anexample, the order is arranged in the order of (i) the order in whichthe number of viewing users following and the number of views by theviewing users is highest, (ii) the order in which the cumulative numberof viewers is highest, and (iii) the order in which the distributionstart is oldest. Additionally, the display range of the thumbnail imagesof the distribution list G25 can be changed by vertical scrolling.

This distribution list G25 will be updated (i) when returning from thescreen of another tab and (ii) when performing a refresh operation(Pull-to-Refresh).

As described above, the user who selects the distribution start objector the play start object becomes a distributing user who makes thedistribution start request or the play start request.

Further, the user who selects a thumbnail image becomes a viewing userwho views the second image.

Further, the first screen includes a first region where scrollingoperation is not possible and a second region where scrolling operationis possible.

The first screen referred to here is the first screen shown in FIG. 10 .The first screen includes a first region R1 and a second region R2.Specifically, the game title is displayed in the first region R1, andthe play start button G21, the game icon G22, the game name G23, thenumber of viewers G24, and the distribution list G25 described above aredisplayed in the second region R2.

The first region R1 is a portion that cannot be scrolled and is fixedlydisplayed on the display screen, and the second region R2 is a portionthat can be scrolled by the user. By scrolling the second region R2, theuser can check the thumbnail images hidden outside the screen.

However, since the play start button G21 may be hidden outside thescreen by scrolling in the second region, the display processor in thisdisclosure can display a play start object (play start button G21) inthe first region R1 according to a display state of a play start object(play start button G21) displayed in the second region R2.

As an example, in FIG. 10 , the play start button G21 is displayed inthe second region R2, but in FIG. 11 , it is displayed in the firstregion R1. That is, when part or all of the play start button G21 is notdisplayed in the second region R2, the play start button G21 appears inthe first region.

Further, the game display processor may display the play start object inthe first region R1 in stages according to the display state of the playstart object displayed in the second region R2.

Such an expression can be realized by changing the transparency of theplay start object according to the scroll amount of the second regionR2.

As an example, a scroll amount (unit is pixels) of 0 to 50 is caused tocorrespond to a button transparency of 0.0 (completely transparent) to1.0 (completely opaque). Then, in the initial display state, the objectis completely transparent and cannot be seen, and when scrolling by 50pixels or more, the object is completely displayed. During that time (0to 50), it is preferable to change the transparency of the objectlinearly. The unit of the scroll amount is a logical pixel, which may bedifferent from an actual pixel of the display.

Further, the game request receiving portion can accept a play endrequest for a predetermined game from the distributing user terminal 100after the game video distribution portion distributes information aboutthe second video.

The play end request can be transmitted by selecting the end buttonarranged on the game screen.

Then, when the game request receiving portion receives the play endrequest of the predetermined game, the video distribution portion canend the distribution of the information about the second video anddistribute the information about the first video.

That is, what is distributed here is not part of the information of thefirst video, but all the information of the first video.

Then, when the video distribution portion ends the distribution of theinformation about the second video and distributes the information aboutthe first video, what is displayed on the viewing user terminal 2200 isthe first video.

The following is an explanation of the flow to start viewing the video.

The one or more processors in this disclosure may further include aviewing receiver.

The viewing receiver receives a video viewing request from the user.

The video distribution portion distributes video and voice informationas video information to the user’s information processing terminal inresponse to the viewing request.

FIG. 12 is an example showing a viewing screen V10 of an avatar videodisplayed on the viewing user terminal 2200.

The viewing user can post a comment by inputting text in a commentposting field V11 and pressing a send button V12.

Further, by pressing a gift button V13, a gift list (screen V30 in FIG.13 ) is displayed to the viewing user, and a display request for thegift designated by selection can be transmitted.

At this time, the one or more processors in this disclosure may includea determination portion. The determination portion determines whetherthere is a gift display request from the viewing user terminal 2200.

The display request can include gift object information. The gift objectinformation includes at least (i) gift object identification informationthat identifies the type of the gift object and (ii) positioninformation that indicates the position where the gift object isdisplayed.

Further, as shown in FIG. 13 , gifts can be displayed separately foreach category (free (paid) gifts, accessories, cheering goods, appeal,variety, or the like).

Here, a paid gift is a gift that can be purchased by the consumption of“My Coin” purchased by the viewing user. A free gift is a gift thatviewers can obtain for free with or without consumption of “My Points.”

The term “gift” used in this application means the same concept as theterm “token.” Therefore, it is also possible to replace the term “gift”with the term “token” to understand the technology described in thisapplication.

Furthermore, the viewing user can post a rating showing favor bypressing a like button V14. In addition to/in place of the like buttonV14, it is also possible to display a button for posting a negativeevaluation or other emotions.

Additionally, if the distributing user has set whether to allow otherusers to appear in the distribution setting, a request for appearance inthe video can be sent by selecting a collaboration request button V15.

Additionally, a follow button V16 for the viewing user to follow thedistributing user is displayed on the screen of a video distributed by adistributing user that the viewing user has not yet followed. Thisfollow button functions as a follow release button on the screen of avideo distributed by a distributing user that the viewing user isalready following.

This “follow” may be performed from a viewing user to a viewing user,from a distributing user to a viewing user, and from a distributing userto a distributing user. However, this “follow” is managed as a one-wayassociation, and a reverse association is managed separately as afollower.

Additionally, a photo button V25 for saving a still image on the screencan also be displayed.

Further, a cheering ranking display button V17, a share button V18, anda ranking display button V19 are also displayed on the viewing screenV10.

The cheering ranking displays the ranking of the viewing user who cheersthe distributing user, and the ranking can be calculated according tothe amount of gifts (points / coins) or the like.

Additionally, regarding the sharing of videos, the viewing user cancheck a list of SNS (Social Networking Services) that can be shared bypressing the share button V18, and can send a fixed link to a designatedlocation of the SNS designated by selection.

Furthermore, by pressing the collaboration application button V15, it ispossible to request collaborative distribution from the distributinguser. Collaborative distribution means that the character object of theviewing user is caused to appear in the distribution video of thedistributing user.

At the top of the viewing screen V10, a distributing user icon V21, adistributing user name (character object name) V22, a cumulativenumber-of-viewers display V23, and a cumulative number-of-likes displayV24 can be displayed.

Further, when the viewing end button V20 is selected, a screen forending viewing appears, and a viewing end request can be transmitted.

The screen for ending such viewing will be described in detail. Such ascreen is called “small window voice distribution,” and is for viewing avideo in a manner of playing only the voice while displaying the video.

The selection of the viewing end button V20 is accepted by the viewingreceiver as a video viewing end request.

At this time, the video distribution portion ends the distribution ofthe video-related information in response to the viewing end request,but does not end the distribution of the voice-related information.

Then, when the video/voice-related information is distributed at theuser terminal, the video is displayed on the main screen at the userterminal, and when only the voice information is distributed, the videois not displayed at the user terminal and a sub screen indicating thatthe video is being viewed is displayed.

FIG. 14 shows an image of a screen V50 on which a sub screen V51 isdisplayed.

When this sub screen V51 is displayed, the main screen displayed on theback transitions to the screen before viewing the video. For example,when moving from a recommendation tab to the viewing frame, the displayreturns to the recommendation tab, and when moving from the follow tabto the viewing frame, the display transitions to the follow tab.

When this sub screen V51 is being displayed, operation on the mainscreen becomes possible, and transition to another screen becomespossible.

On the sub screen V51, a profile image, a name, a title, and a voiceicon that can visually identify that voice is playing are displayed.

Then, by selecting an end icon V52 displayed on the sub screen V51, theviewing can be completely ended.

Regarding the end of the display of the video, the information may betransmitted from the server device, but not displayed at the terminalside, or the transmission of the information itself from the serverdevice may be stopped.

With such a configuration, it becomes possible to search for otherdistributions and enjoy chatting with other users while listening onlyto sound.

Next, a “collaboration” in which another user appears in the video ofthe distributing user will be described.

As described above, the viewing user can send a request to participatein the video via the confirmation screen of the collaborativedistribution participation request displayed by pressing thecollaboration request button V15 shown in FIG. 12 .

A collaboration avatar display portion included in one or more computerprocessors in this disclosure causes the video to display a characterobject generated based on the movement of the viewing user who made theparticipation request in response to the participation request receivedby the receiver.

FIG. 15 shows, as an example, a viewing or distribution screen when asecond avatar A2, which is a character object of a guest user,participates in a video in which the first avatar A1, which is thecharacter object of the host user, is displayed. In FIG. 15 , thedisplay of objects other than the avatars is omitted.

Further, as shown in FIG. 16 , a third avatar A3, which is a characterobject generated based on the movement of another viewing user, mayparticipate in the video. Additionally, although the third avatar A3 isarranged behind the first avatar A1 and the second avatar A2 in FIG. 16, the three people may be arranged so as to line up in a horizontal row.Further, the arrangement position of the avatars may be designated bythe distributing user.

FIG. 17 shows a list screen T30 of users having a mutual followrelationship, which is displayed by selecting the follow tab on the topscreen shown in FIG. 5 . Mutual follow is a relationship in which eachis a follower of the other.

On the list screen T30, profile images and names of users who have amutual follow relationship are displayed.

As shown in FIG. 17 , it is assumed that a first object T31 is displayedon the list screen T30 for each of the users having a mutual followrelationship. Further, a chat object T32 may be displayed together withthe first object T31. By selecting this chat object, it is possible totransition to an individual chat screen with the second user.

The first object T31 transmits a predetermined notification to theterminal of the user associated with the first object T31.

The predetermined notification may be, for example, a call notification.

First Embodiment

Subsequently, various functions that can be executed in the first userterminal 100, the second user terminal 200, and/or the server device 400included in the information processing system 3000 according to a firstembodiment of this disclosure will be described with reference to thedrawings.

As shown in FIG. 18 , the one or more computer processors included inthe information processing system 3000 according to the first embodimentof this disclosure include a transmitter 411, a receiver 412, a firstvideo generator 413, and a second video generator 414, and a videoswitching portion 415.

Here, the transmitter 411, the receiver 412, the first video generator413, the second video generator 414, and the video switching portion 415are all described as being provided in the server device 400, but thedescription is not limited to this.

The transmitter 411 transmits, to the second user terminal 200 of asecond user, information about a video including the character object ofa first user.

The video can be a video including a character object CO of the firstuser, as shown as an example in FIG. 19 .

The information about the video may be any information that enables thevideo to be viewed on the second user terminal 200, and the rendering ofthe video may be performed at the server device 400 or the first userterminal 100, or may be performed at the second user terminal 200.

The movement of the face of the first user taken by a camera (here, afront camera as an example) included in the first user terminal 100 maybe reflected in at least the face of the character object CO included inthe video.

The receiver 412 receives a display request for the first object fromthe second user terminal 200.

The first object can be, for example, the gift object described above.As shown in FIGS. 13 and 20 , the second user can send a display requestfor a desired gift object(s) from the gift list screen V30 displayed onthe second user terminal 200. Points (P, pt) shown in the figures areavailable to the user free of charge for rewards and events in thissystem. Coins (C) shown in the figures can be obtained for a fee bybeing purchased by the user.

The first video generator 413 generates first information for displayingin a first region in the virtual space, as a first video, (i) acharacter object of the first user and (ii) a first object.

The above first information differs depending on the content of thevideo, but as an example, in the case of a video in which the characterobject of the distributing user appears as described above, motioninformation indicating the movement of the character object, voiceinformation of the distributing user, gift object information thatindicates a gift sent by the viewing user, and the like are included.Additionally, the gift object information includes, at least, (i) giftobject identification information that identifies the type of giftobject and (ii) location information that indicates a position at whichthe gift object is displayed.

FIG. 19 shows an image of the screen V10 displaying the first videodisplayed on the display portion of the first user terminal 100 and/orthe second user terminal 200. The screen V10 shown in FIG. 19 includesat least the character object CO and the first object G1. Althoughomitted in FIG. 19 , various display and operation UIs may besuperimposed and displayed as shown in FIGS. 8 and 12 .

The second video generator 414 generates second information for causinga second object S1 different from the first object G1 to be displayed ina second region in the virtual space, as the second video, and fordisplaying the character object CO of the first user so as to be movablein the first region and the second region.

Unlike the first object G1, the second object S1 is not displayed inresponse to a display request from the second user terminal 200, but theserver device 400 (system side) controls its display position andtiming.

FIG. 21 shows an image of a screen V40 displaying the second videodisplayed on the display portion of the first user terminal 100 and/orthe second user terminal 200. The screen V40 shown in FIG. 21 includesat least a character object CO and second objects S1. Although omittedin FIG. 21 , various display and operation UIs may be superimposed anddisplayed as shown in FIGS. 8 and 12 .

Here, the image of an expansion of the virtual space in this disclosurewill be described in detail with reference to FIG. 22 .

As shown as an example in FIG. 22 , the virtual space in this embodimentis arranged so that a disk-shaped island (world) is floating in the air.This island is an object in the form of a tower-shaped cake with its topand bottom reversed, and various objects can be arranged on thedisk-shaped ground. Additionally, this island and the ground are shownas an example, and their display modes are not particularly limited.

As the objects, at least the above-mentioned character object CO, firstobject G1, and second objects S1 can be displayed.

In this way, it is the “world” that is provided as the content of thesecond video, and the “world” proceeds by executing the above-mentioned“world function.”

FIG. 23 is a top view of the ground shown in FIG. 22 , and is an imagediagram for explaining the first region and the second region in theabove configuration. Each object is drawn in a front view for ease ofviewing.

As shown in FIG. 23 , the regions in which the character object CO canmove can be a first region R10 and a second region R20 in the virtualspace.

The first region R10 and the second region R20 may be continuousregions, and their positional relationship and shape are notparticularly limited.

As an example, the first video is generated as an image obtained bycapturing the first region R10 from a position of a virtual camera VC1shown in FIG. 24 (FIG. 19 ). The position, orientation, and the like ofthe virtual camera VC1 can be changed within a predetermined range bythe operation of the first user.

Further, as an example, the second video is generated as an imageobtained by capturing the first region R10 and/or the second region R20from a position of a virtual camera VC2 shown in FIG. 25 (FIG. 21 ). Theposition, orientation, and the like of the virtual camera VC2 can bechanged by the operation of the first user, but basically, the virtualcamera moves following the movement of the character object CO. Thedetails of a method of operating the virtual camera VC2 will bedescribed later.

Thus, the first video and the second video can be videos taken in thesame virtual space (world). Alternatively, the first video and thesecond video may be videos captured in separate virtual spaces. In thiscase, the second video is the video taken in the above world.

Furthermore, the configuration may be such that so that a room, which isa private space of the first user provided in the virtual space, may beset as the first region, and the outside of the room, which is a publicspace, may be set as the second region, and the first user may move backand forth between these regions.

In response to an instruction from the first user terminal 100 of thefirst user, the video switching portion 415 switches, between the firstvideo and the second video, the video to be displayed on the second userterminal 200.

The above instruction may be transmitted to the server device 400 by anoperation on a predetermined operation UI displayed in the first videoand the second video displayed on the first user terminal 100.

As an example, switching from the first video to the second video orfrom the second video to the first video can be performed by selectingthe switching button displayed in the first video and the second video.

When the world function as a second video is provided as one of theabove-mentioned games, the above-mentioned game distribution start andend procedures can be applied.

Specifically, the switching from the first video to the second video canbe performed by selecting the play start button D33 (FIG. 8 ) of thegame displayed in the first video or the play button G11, G21 (FIGS. 9and 10 ) of one game selected from among the game list displayed on theprevious screen transitioned by selecting the play start button D33.

Further, the switching from the second video to the first video can beperformed by selecting the play end button V41 (FIG. 21 or the like)displayed on the second video.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or users’ motivation to interact with each other.

Specifically, first, the presence of two types of videos, the firstvideo and the second video, improves the entertainment value of thevideos.

In particular, in the virtual space “world”, which is the stage of thesecond video, an attractive second object is arranged according to atheme, and the character object can move freely and videos can begenerated from any viewpoint and any place, thereby making it possibleto generate videos that are more personalized than the first video.

Additionally, by generating a video of the above world being explored,it is easy to create topics of discussion in talks and comments.

Also, by making it possible to switch between these two types of videos,the distribution time will inevitably be longer.

Thus, the presence and switching of the two types of videos, the firstvideo and the second video, improve the quality of the video content.

Additionally, by improving the quality of the video content, the viewingmotivation of the user who views the video is also improved, and thedistribution motivation of the user who distributes the video is alsoimproved as the number of viewing users increases.

Additionally, this increase in motivation to distribute and view willlead to more active interaction between distributing users and viewingusers, and further, more active interaction among distributing users andamong viewing users.

The virtual space displayed by executing the above-mentioned worldfunction has been described as a space for distributing the secondvideo. However, it can be used not only as a space for distributing thesecond video, but also as a virtual space for a plurality of avatarscorresponding to a plurality of users to freely walk around andcommunicate with each other.

Additionally, one avatar (first user) among the plurality of avatars inthe virtual space may be configured to be able to distribute the firstvideo as a distributing user. That is, according to the informationprocessing system of this disclosure, one-to-many video distribution canbe performed in a many-to-many metaverse virtual space.

Subsequently, another application example in the first embodiment willbe described.

When the video is switched from the first video to the second video bythe video switching portion 415, the second video generator 414 cangenerate second information while maintaining the display of a firstobject G1 that has already been displayed in the first region.

Specifically, the first objects G1 (apple objects) displayed on thescreen V10 of the first video shown in FIG. 19 are continuouslydisplayed even if it is changed to the screen V40 of the second videoshown in FIG. 21 .

When the video is switched from the second video to the first video bythe video switching portion 415, the first video generator 413 cangenerate the first information while maintaining the display of thefirst object G1 already displayed in the first region.

Specifically, the first objects G1 (apple objects) displayed on thescreen V40 of the second video shown in FIG. 21 are continuouslydisplayed even if it is changed to the screen V10 of the first videoshown in FIG. 19 . At this time, not only a first object G1 displayed inthe first region, but also a first object G1 displayed in the secondregion may be configured to be continuously displayed by changing thedisplay position.

Additionally, since the display of the first objects G1 is controlledbased on the display time set for each first object G1, the display ofthe first objects G1 ends with the lapse of the display period from thestart of the display. The display request of the first object G1 can bemade during both the display of the first video and the display of thesecond video, and in either case, regardless of whether the video isswitched in progress, the display of the first object G1 continues untilthe display period elapses. In other words, since the display time ofthe gift given by the viewing user is not changed by the operation(action) of the distributing user, the viewing user who gave the gift byconsuming coins or the like is not dissatisfied.

The second video generator 414 can change at least a second object S1 toanother second object S1 based on a predetermined condition.

In the example shown in FIGS. 21 and 22 , the second objects S1 are, forexample, a dog object, a pumpkin object, a tower cake object, and thelike, but among these second objects S1, at least the dog object and thepumpkin objects can be changed to a jellyfish object and fish objects asshown in FIGS. 26 and 27 , as an example. Also, there may be a secondobject(s) S1 that does not change, such as the tower cake object. Thechange of a second object S1 in this disclosure is referred to as atheme change.

The predetermined condition may be that a scheduled time has arrived, ascheduled period has elapsed, or a change instruction has been receivedfrom the first user or another user.

When the predetermined condition is the arrival of a scheduled time, thesecond video generator 414 changes the second object to another secondobject when the scheduled time arrives, regardless of the videodistribution start time. As an example, the scheduled time can be timesat regular intervals such as 10:20, 10:40, and 11:00. Scheduled timescan be morning (6:00), noon (12:00), and night (18:00). These times maybe changed according to the actual sunrise and sunset times.

Additionally, the arrival of the scheduled time also includes thearrival of a scheduled date and time. In this case, the second videogenerator 414 changes the second object to another second object whenthe scheduled date and time arrives, regardless of the distributionstart time of the video. As an example, the scheduled date and time canbe the start date and time of an event such as Oct. 31st 0:00(Halloween), Dec. 25th 0:00 (Christmas), and Jan. 1st 0:00 (New Year’sDay).

When the predetermined condition is the lapse of a scheduled period, thesecond video generator 414 changes the second object to another secondobject when the scheduled period has elapsed from the video distributionstart time. As an example, the scheduled period can be 20 minutes, 40minutes, 60 minutes, or the like at regular intervals from the start ofdistribution.

When the predetermined condition is that a change instruction from thefirst user or another user is received, the second video generator 414changes the second object to another second object upon receiving achange instruction from the first user or another user during thedistribution of the video. As an example, the change instruction can begiven by selecting the change instruction object displayed on thescreen. The other user referred to here includes not only a viewinguser, but also a guest user described later.

If the predetermined condition is the arrival of a scheduled time or thelapse of a scheduled period, the scheduled time or the time until thesecond object will be changed may be displayed in the video.

Furthermore, the second video generator 414 may generate the secondinformation while maintaining the display of a first object G1 alreadydisplayed in the first region or the second region even if a secondobject S2 is changed to another second object S2.

Specifically, the first objects G1 (apple objects) displayed on thescreen V40 of the second video shown in FIG. 21 continue to be displayedeven if the screen changes to the screen V40 of the second video shownin FIG. 26 .

Furthermore, the display of the first objects G1 is controlled based onthe display period set for each first object G1. Therefore, the displayof the first objects G1 ends when the display period elapses from thestart of the display. The display of the first objects G1 continuesuntil the lapse of the display period regardless of whether the secondobjects S1 is changed.

Further, as shown in FIG. 28 , one or more computer processors in thisdisclosure may further include an effect generator 416.

When an already displayed first object G1 or a newly displayed firstobject G1 has a specific relationship with a second object S1, theeffect generator 416 generates a predetermined effect.

Specifically, the presence or absence of the specific relationship isdetermined based on combined data stored in advance in a predeterminedstorage portion. As an example, identification numbers and/or attributeinformation are associated with each of the first object and the secondobject, and when they match or are associated, it is determined thatthey have a specific relationship.

Attribute information includes, for example, attributes related toseasons (summer, winter, and the like), attributes related to events(Halloween, Christmas, year-end and New Year, and the like), attributesrelated to location (sea, space, sky, or the like), or the like.

The timing of the above determination is the timing when the displayrequest of a first object is received, the timing when a first object isdisplayed, or the timing when a second object is changed to anothersecond object.

Predetermined effects include, but are not limited to, displayinganother object, generating a sound effect, and the like. Another objectcan be, for example, an effect object such as a confetti object, acracker object, or a decorated vessel object.

Further, as shown in FIG. 28 , one or more computer processors in thisdisclosure may further include a movement operation receiver 417 and avirtual camera controller 418.

The movement operation receiver 417 accepts a movement operation of thecharacter object of the first user in the virtual space. The details ofthe movement operation will be described later.

The virtual camera controller 418 controls the operation of the virtualcamera that shoots in the virtual space. The details of the operationcontrol will be described later.

Furthermore, in the embodiment of this disclosure, movement of the faceof the character object of the first user can be generated based on themovement of the face of the first user captured by a front camera of thefirst user terminal 100.

Then, the first video generator 413 can generate movement of the face ofthe character object of the first user in an inverted state invertedwith respect to the movement of the face of the first user.

Specifically, when the first user winks with the right eye, thecharacter object of the first user winks with the left eye. The firstuser performs distribution while looking at the face of the characterobject displayed on the first user terminal 100. Therefore, by settingthe inverted state (mirror display), the first user can performdistribution with an intuitive feeling (operation) as if looking at amirror. In a non-inverted state in which the right/left are not inverted(that is, a state in which the character object winks with the right eyewhen the first user winks with the right eye), a sense of incongruityoccurs, and it is difficult to operate with an intuitive feeling.

The second video generator 414 can generate the movement of the face ofthe first user’s character object in an inverted state or a non-invertedstate according to the positional relationship between the first user’scharacter object and the virtual camera.

As an example, when the virtual camera is located in a front range ofthe character object of the first user (as an example, a range of 90degrees to the right/left from the front of the character object), themovement of the face of the character object is generated in an invertedstate. When the virtual camera is located outside the front range of thecharacter of the first user (as an example, a range exceeding 90 degreesto the right/left from the front of the character object), the movementof the face of the character object is generated in a non-invertedstate.

Specifically, when the virtual camera is determined to be a position inthe front range of the character object of the first user, once thefirst user winks with the right eye, the character object of the firstuser winks with the left eye. Conversely, when the virtual camera isdetermined to be in a position exceeding the front range of thecharacter object of the first user, once the first user winks with theright eye, the character object of the first user winks with the righteye.

In the above example, the movement of the face has been described, butthe movement of the head and arms can be controlled in the same manner.

According to this, it is possible to eliminate a sense of incongruity onthe display caused by the positional relationship between the virtualcamera and the character object.

The inverted state and the non-inverted state may be switched accordingto the instruction of the first user.

Further, when the character object of the first user moves beyond amovable region, the second video generator 414 can cause the characterobject of the first user to reappear from another position in thevirtual space.

When the virtual space is a space as shown in FIGS. 22 and 27 , when thecharacter object moves beyond the edge of the disk-shaped ground, thecharacter object can be caused to fall below the tower and caused toreappear as if falling from the upper center of the disk-shaped ground.By centering on the reappearance position, it is convenient for thecharacter object to go in any direction in the world. Also, if it getslost in the world, it can return to the reference center position.

As described above, according to the configuration of the firstembodiment, it is possible to provide technical improvements that solveor alleviate at least part of the above-mentioned problems of theconventional technology. Specifically, according to the aboveconfiguration, it is possible to improve distributing users’distribution motivation, viewing users’ viewing motivation, and/orusers’ motivation to interact with each other.

Second Embodiment

Subsequently, various functions that can be executed in the first userterminal 100, the second user terminals 200, and/or the server device400 included in the information processing system 3000 according to asecond embodiment of this disclosure will be described with reference tothe drawings.

As shown in FIG. 29 , one or more computer processors included in theinformation processing system 3000 according to the second embodiment ofthis disclosure include a transmitter 421, a receiver 422, a first videogenerator 423, and a second video generator 424.

Here, the transmitter 421, the receiver 422, the first video generator423, and the second video generator 424 are all described as beingincluded in the server device 400, but this disclosure is not limitedthereto.

The transmitter 421 transmits information about the video including thecharacter object of the first user to the second user terminal 200 ofthe second user. The transmitter 421 can have the same configuration asthe transmitter 411 described above.

The receiver 422 receives a display request for the first object fromthe second user terminal 200. The receiver 422 can have the sameconfiguration as the receiver 412 described above.

The first video generator 423 generates, as a first video, firstinformation for displaying, in a first region in the virtual space, (i)character object of the first user and (ii) a first object. The firstvideo generator 423 can have the same configuration as the first videogenerator 413 described above.

The second video generator 414 generates second information for causinga second object S1 different from the first object G1 to be displayed ina second region in the virtual space, as a second video, and fordisplaying the character object CO of the first user so as to be movablein the first region and the second region. The second video generator424 can have the same configuration as the second video generator 414described above.

Based on the arrangement position information associated with the firstobject G1, the second video generator 440 displays the first object G1at a predetermined position in the first region R10 (FIG. 23 , and thelike) or at a position associated with the character object CO of thefirst user.

As mentioned in the description of the gift object, the first objectinformation of the first object G1 includes position information(arrangement position information) indicating the position where thefirst object G1 is displayed.

As an example, the arrangement position information of the first objectG1 defines the coordinates of a predetermined position (predeterminedregion) in the first region R10 or a part of the character object CO ofthe first user.

In this disclosure, a first object G1 having the former arrangementposition information is called a non-wearing object, and a first objectG1 having the latter arrangement position information is called awearing object.

The appearance position (display start position) of the first object G1may be different from the above-described arrangement position.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users ‘viewingmotivation, and/or users’ motivation to interact with each other.

Specifically, first, the presence of two types of videos, the firstvideo and the second video, improves the entertainment value of thevideos.

In particular, in the virtual space “world”, which is the stage of thesecond video, an attractive second object is arranged according to atheme, and the character object can move freely and videos can begenerated from any viewpoint and any place, thereby making it possibleto generate videos that are more personalized than the first video.

Additionally, by generating a video of the above world being explored,it is easy to create topics of discussion in talks and comments.

By making it possible to display the first object not only in the firstvideo but also in the second video, it will be possible to provide thefirst video and the second video without unnecessarily discouraging aviewing user from providing a gift(s).

Thus, the presence and switching of the two types of videos, the firstvideo and the second video, improve the quality of the video content.

Additionally, by improving the quality of the video content, the viewingmotivation of users who view videos is also improved, and thedistribution motivation of users who distribute videos is also improvedas the number of viewing users increases.

Additionally, this increase in motivation to distribute and view willlead to more active interaction between distributing users and viewingusers, and further, to more active interaction among distributing usersand among viewing users.

The virtual space displayed by executing the above-mentioned worldfunction has been described as a space for distributing the secondvideo. However, it can be used not only as a space for distributing thesecond video, but also as a virtual space for a plurality of avatarscorresponding to a plurality of users to freely walk around andcommunicate with each other.

Additionally, one avatar (one user) among the plurality of avatars inthe virtual space may be configured to be able to distribute the firstvideo as a distributing user. That is, according to the informationprocessing system of this disclosure, one-to-many video distribution canbe performed in a many-to-many metaverse virtual space.

When displaying a first object G1, the second video generator 424 candisplay a system comment indicating that the first object G1 is beingdisplayed in the second video.

Alternatively, when the second video generator 424 receives a displayrequest of the first object G1, it is possible to display a systemcomment to the effect that the display request for the first object G1has been made (to the effect that gifting has been received) in thesecond video.

FIGS. 30 and 31 show, on the screen V40 displaying the second videodisplayed on the first user terminal 100 and/or the second user terminal200, how comments from the first user, second user and/or the systemside are displayed. Although omitted in FIGS. 30 and 31 , variousdisplay and operation UIs may be superimposed and displayed as shown inFIGS. 8 and 12 .

In the examples shown in FIGS. 30 and 31 , the comment “Mr./Ms. OOO gavebananas x 3” is displayed as a system comment to the effect that thefirst object G1 (banana object) is displayed.

The system comment may be displayed in a manner different from thecomments from the first user and the second user. For example, apredetermined mark (a balloon mark “There it is!” in FIG. 31 ) may bedisplayed as a system comment indicating that the first object G1 isdisplayed.

In the embodiment of this disclosure, the character object CO of thefirst user can move between the first region R10 and the second regionR20. For example, as shown in FIG. 31 , while the character object CO ofthe first user is moving in the second region R20 far away from thefirst region R10, when the first object G1 is arranged in the firstregion R10, the display of such a system comment is useful because thefirst object G1 may not be displayed on the screen.

As shown in FIG. 32 , the one or more computer processors in thisdisclosure may further include a movement operation receiver 425 and avirtual camera controller 426.

The movement operation receiver 425 accepts the movement operation ofthe character object of the first user in the virtual space. The detailsof the movement operation will be described later.

The virtual camera controller 426 controls the operation of the virtualcamera that shoots in the virtual space. The details of the operationcontrol will be described later.

When the first object G1 is displayed at a predetermined position in thefirst region R10, the virtual camera controller 426 can control theoperation of the virtual camera according to the positional relationshipbetween the predetermined position and the virtual camera.

As an example, as shown in FIG. 33 , the virtual camera controller 426adjusts the orientation and position of the virtual camera so that thefirst object G1 displayed at a predetermined position in the firstregion R10 is within a capturing range. This is automatically appliedeven if the virtual camera is being operated by the user as describedlater.

At this time, the virtual camera is controlled so that both the firstobject G1 and the character object CO fit within the capturing range.

Meanwhile, when the virtual camera controller 426 cannot include thefirst object and the character object in the same screen due to thepositional relationship between the predetermined position and thevirtual camera, the virtual camera controller 426 can control theoperation of the virtual camera so that the first object is included inthe screen.

As an example, as shown in FIG. 34 , the virtual camera controller 426adjusts the orientation and position of the virtual camera so that onlythe first object(s) G1 displayed at a predetermined position in thefirst region R10 falls within the capturing range. This is automaticallyapplied even if the virtual camera is being operated by the user asdescribed later.

When the second video generator 224 displays the first object G1 at apredetermined position in the first region R10, depending on theposition of the character object CO in the virtual space, the secondvideo generator 224 can display a marker object M1 indicating theposition of the first object in the virtual space.

As an example, as shown in FIG. 35 , the second video generator 424displays the marker object M1 to point to (in the direction of) thefirst object displayed at a predetermined position in the first regionR10, regardless of the current position and orientation of the virtualcamera.

Additionally, the second video generator 424 can display the firstobject at a position associated with the character object CO of thefirst user even if the arrangement position information associated withthe first object G1 should display the first object at a predeterminedposition in the first region R10.

As an example, as shown in FIG. 36 , the second video generator 424causes the first objects G1 to be displayed at a position (overhead)associated with the character object CO of the first user. According tothis example, regardless of where the character object CO of the firstuser is in the virtual space, it is possible to increase the possibilitythat the first objects G1 are included in the capturing range. Thisallows effective notice of the gifts that are important to thedistributing user and the viewing user on the display screen of alimited size that cannot display all of the large virtual space.

According to the above second embodiment, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or users’ motivation to interact with each other.

Third Embodiment

Subsequently, various functions that can be executed in the first userterminal 100, the second user terminal 200, and/or the server device 400included in the information processing system 3000 according to a thirdembodiment of this disclosure will be described with reference to thedrawings.

As shown in FIG. 37 , one or more computer processors included in theinformation processing system 3000 according to the third embodiment ofthis disclosure include a transmitter 431, a receiver 432, a first videogenerator 433, a second video generator 434, and an association portion435.

Here, the transmitter 431, the receiver 432, the first video generator433, the second video generator 434, and the association portion 435 areall described as being provided by the server device 400, but thisdisclosure is not limited thereto.

The transmitter 431 transmits, to the second user terminal 200 of asecond user, information about a video including the character object COof the first user. The transmitter 431 can have the same configurationas the transmitter 411 described above.

The receiver 432 receives a display request for the first object fromthe second user terminal 200. The receiver 432 can have the sameconfiguration as the receiver 412 described above.

The first video generator 433 generates first information for displayingas a first video, in a first region in the virtual space, (i) acharacter object of the first user and (ii) a first object. The firstvideo generator 433 can have the same configuration as the first videogenerator 413 described above.

The second video generator 434 generates second information for causinga second object S1 different from the first object G1 to be displayed ina second region in the virtual space, as a second video, and fordisplaying the character object CO of the first user so as to be movablein the first region and the second region. The second video generator434 can have the same configuration as the second video generator 414described above.

As shown in FIG. 38 , the second video generator 434 causes the secondregion R20 to display third objects P1 different from the first objectsG1 and the second objects S1.

FIG. 39 shows an image of third objects P1. In FIG. 39 , two-dimensionalpanel-shaped objects P11 to 14 are shown as third objects P1. The thirdobjects are not limited to two-dimensional panel-shaped objects, and maybe three-dimensional objects.

Wearing objects are displayed together with character images in theobjects P11 to P14, respectively. Each character image displayed on theimage object may be an image of the character object of the first user,or another image.

When the character object CO of the first user and the third object P1have a predetermined relationship, the association portion 435associates the character object CO of the first user with a fourthobject W1 associated with the third object P1.

The predetermined relationship is that (i) at least part of thecharacter object CO (hands, feet, or the like) touches the third objectP1, (ii) the distance between the character object CO and the thirdobject P1 has become a predetermined distance, (iii) the characterobject CO pressed a button object associated with the third object P1,or the like. Touching the third object P1 above includes the characterobject CO (i) having been in contact with the third object P1 for apredetermined time, (ii) having been within a predetermined distance fora predetermined time, and (iii) having been pressing for a predeterminedtime.

These predetermined relationships are not particularly limited, but thesecond user who is watching the video can visually understand that thecharacter object CO of the first user is trying to associate with thefourth object W1.

Furthermore, when the fourth object W1 is associated with the characterobject CO of the first user by the association portion 435, the secondvideo generator 434 displays the fourth object W1 in association withthe character object CO of the first user.

That is, the character object CO is made to wear the wearing objectdisplayed on the third object P1 and displayed as the fourth object W1.In the examples shown in FIG. 39 , an example is displayed in which thecharacter object CO of the first user has a predetermined relationshipwith the third object P14, and a fourth object (glitter object) W14,which is a wearing object displayed on the third object P14, is wornaround the head of the character object CO.

The fourth object W1 may be the same object as a gift object that thesecond user can request to display as a gift, as will be describedlater, or may be a special object that cannot be given as a gift.

In the former case, the fourth object W1 corresponds to a high-valuegift. This is because a high-value gift is rarely given by a seconduser, making it difficult for the first and second users to see/wear theobject. However, by making it possible to wear it for free in this worldfunction, the world function will be revitalized, which will lead to themotivation to try using it in the first video.

Further, the same object P1 may be displayed to all users, or differentobjects may be displayed depending on the theme of the displayed world.Further, the displayed third object P1 may be determined based on theinformation of the first user.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or users’ motivation to interact with each other.

Specifically, first, the presence of two types of videos, the firstvideo and the second video, improves the entertainment value of thevideos.

In particular, in the virtual space “world”, which is the stage of thesecond video, an attractive second object is arranged according to atheme, and the character object can move freely and videos can begenerated from any viewpoint and any place, thereby making it possibleto generate videos that are more personalized than the first video.

Additionally, by generating a video of the above world being explored,it is easy to create topics of discussion in talks and comments.

Furthermore, by displaying the third object displayed in the secondvideo and allowing the character object to freely wear the correspondingfourth object, it will be easier to create topics in talks and comments,and interaction between users will become more active.

Further, by visually expressing the process up to wearing the fourthobject in the video, it is possible to give the feeling of anticipationto the first user and/or the second user.

If the fourth object corresponds to a high-value gift, the high-valuegift is rarely given by the second user. Therefore, the first user andthe second user cannot easily see/wear the object. However, by making itspecially wearable in this world function, the world function will berevitalized, which will lead to the motivation to use it in the firstvideo.

Thus, the presence and switching of the two types of videos, the firstvideo and the second video, and the fourth object improve the quality ofthe video content.

Additionally, by improving the quality of the video content, the viewingmotivation of users who view videos is also improved, and thedistribution motivation of users who distribute the videos is alsoimproved as the number of viewing users increases.

Additionally, this increase in motivation to distribute and view willlead to more active interaction between distributing users and viewingusers, and further, to more active interaction among distributing usersand among viewing users.

The virtual space displayed by executing the above-mentioned worldfunction has been described as a space for distributing the secondvideo. However, it can be used not only as a space for distributing thesecond video, but also as a virtual space for a plurality of avatarscorresponding to a plurality of users to freely walk around andcommunicate with each other.

Additionally, one avatar (one user) among the plurality of avatars inthe virtual space may be configured to be able to distribute the firstvideo as a distributing user. That is, according to the informationprocessing system of this disclosure, one-to-many video distribution canbe performed in a many-to-many metaverse virtual space.

The second video generator 434 can display a loading image for apredetermined time when the association portion 435 makes anassociation.

FIG. 40 shows an example of the above-described loading image L1. InFIG. 40 , the loading image L1 is displayed at the same time that thecharacter object CO steps on the third object P1 (P11), and when acircular meter increases from 0% to 100%, a fourth object W1 (W11) isattached to the character object CO.

This is a display so that the second user who is viewing can understandthat the character object is trying to associate with the fourth object,by intentionally taking the loading time. This can further increase thefeeling of anticipation of the first user and/or the second user.

The time until the meter is filled (loading time) is not particularlylimited, but the higher the value of the fourth object, the longer theloading time may be.

As shown in FIG. 41 , the one or more computer processors in thisdisclosure may further include a selection screen generator 436.

The selection screen generator 436 generates information for displayingthe selection screen V30 for making a display request for a first objectG1 on the second user terminal 200.

As shown in FIG. 20 , a plurality of images for making a display requestfor first objects G1 are selectably displayed on the selection screenV30.

Then, of the images, the image for making a display request for a firstobject G1 related to the fourth object can be displayed in a differentmanner from the other images, as shown in FIG. 42 .

For example, in a state where the first user can freely wear a trianglehat as the fourth object in the second video, there is little advantagein the display if the second user gives the gift of the triangle hat.(However, since it contributes to the amount (points) of the giftobtained by the first user (given by the second user), there is anadvantage in that respect.)

Therefore, the second user can display the image of the first object G1related to the fourth object in a manner different from that of theother images, and can select it after understanding the abovecircumstances.

The term “related to the fourth object” is not limited to the case whereit is the same as the fourth object, but also includes the case wherethe display position of a different object is substantially the same asthat of the fourth object.

As an example of the above different manner, FIG. 42 shows an example inwhich the frame is emphasized, but tags may be added, colors may bechanged, and the like.

Furthermore, when the display request of the first object G1 related tothe fourth object is made by the second user, a special effect may occurin the video.

Special effects include, but are not limited to, displaying anotherobject, generating a sound effect, and the like. Another object can be aproduction object such as a confetti object, a cracker object, or thelike.

According to such a configuration, the disadvantage on the display canbe compensated.

As shown in FIG. 41 , the one or more computer processors of thisdisclosure may further include a determination portion 437.

When there is a display request for a first object G1 that should bedisplayed in association with a specified position of the characterobject CO of the first user, the determination portion 437 determineswhether the fourth object W1 is already displayed in association withthe specified position of the character object CO of the first user.

FIG. 43 shows an example of a processing flow including a determinationstep by the determination portion 437.

As shown in FIG. 43 , one or more computer processors perform a step ofdetermining if there has been a display request for a first object thatshould be displayed in association with a specified position of thecharacter object of the first user (S401).

If it is determined that there has been a request to display a firstobject that should be displayed in association with a specified positionof the character object of the first user, a step of determining whethera fourth object is displayed in association with a specified position ofthe character object of the first user is executed (S402). The specifiedposition may be the same position or include substantially the sameposition.

If it is determined that the fourth object is already displayed inassociation with a specified position of the character object of thefirst user, the second video generator 440 can display the first objectin place of the fourth object, or can display both the fourth object andthe first object in association with a specified position.

That is, if it is determined that the fourth object is displayed inassociation with a specified position of the character object of thefirst user, the second video generator 440 displays the first object inplace of the fourth object, or displays both the fourth object and thefirst object in association with a specified position (S403).

Whether to display the first object in place of the fourth object or todisplay both the fourth object and the first object can be determined bythe nature of the first object. For example, if the value of the firstobject is higher than the reference, the first object is displayed inplace of the fourth object, and if the value of the first object islower than the reference, both are displayed. The reference may be avalue when the fourth object is a gift, or may be set by the first useror the administrator side.

If it is determined that a fourth object is not displayed in associationwith a specified position of the character object of the first user, thesecond video generator 440 executes a step of displaying the firstobject in association with a specified position (S404).

As another example, when there is a request to display the first objectthat should be displayed in association with a specified position of thecharacter object of first user, if it is determined by the determinationportion 437 that the fourth object is already displayed in associationwith the specified position of the character object of the first user,the second video generator 434 can display the first object in place ofthe fourth object based on an instruction from the first user terminal.

At this time, the display instruction object for giving the aboveinstruction may be displayed on the screen of the first user. As aresult, the first user can display the first object, which is a giftfrom the second user, at his/her preferred timing.

In the above example, it is determined whether the fourth object isalready displayed, but the reverse is also true.

That is, as shown in FIG. 44 , the one or more computer processorsexecute a step of determining whether the character object CO of thefirst user and the third object P1 have a predetermined relationship(S405).

Then, if it is determined that the character object CO of the first userand the third object P1 have a predetermined relationship, a step ofdetermining whether the first object is displayed in association with aspecified position of the character object of the first user is executed(S406). The specified position may be the same position or includesubstantially the same position.

Then, if it is determined that the first object is displayed inassociation with a specified position of the character object of thefirst user, the second video generator 440 executes a step of displayingthe fourth object in place of the first object, or displaying both thefourth object and the first object in association with a specifiedposition (S407).

Whether to display the fourth object in place of the first object, or todisplay both the fourth object and the first object, can be determinedby the nature of the fourth object. For example, if the value of thefourth object is higher than the value of the first object, the fourthobject is displayed instead of the first object; if the value of thefourth object is lower than the value of the first object, both aredisplayed; or the like. The value of the fourth object can be the valuewhen the fourth object is a gift.

If it is determined that the first object is not displayed inassociation with the specified position of the character object of thefirst user, the second video generator 440 executes a step of displayingthe fourth object in association with a specified position (S408).

As another example, when the determination portion 437 determines thatthe first object is already displayed in association with a specifiedposition of the character object of the first user, the second videogenerator 434 can display the fourth object in place of the first objectbased on an instruction from the first user terminal.

At this time, a display instruction object for providing the aboveinstruction may be displayed on the screen of the first user. As aresult, the first user can display the fourth object at his/herpreferred timing.

As shown in FIG. 38 , the second video generator 440 can display a fifthobject P2 different from the second objects S1 and the third objects P1,in the second region R20.

The fifth object P2 is a release object as shown in FIG. 45 as anexample.

Then, when the character object of the first user and the fifth objectP2 have a predetermined relationship, the association portion 435 canrelease the association of the fourth object associated with thecharacter object of the first user.

That is, the fifth object P2 is an object for breaking the associationbetween the fourth object W1 and the character object CO and making it“non-display.” The predetermined relationship can be the same asdescribed in the description of the third object.

Further, when the fourth object W1 is associated with the characterobject CO of the first user, when the character object CO of the firstuser and the third object P1 have a predetermined relationship again,the association of the fourth object W1 associated with the characterobject CO of the first user can be released.

That is, when the character object CO steps on the third object P1 once,the fourth object W1 is associated, and when the character object COsteps on the third object P1 for the second time, the association of thefourth object W1 is released and the object W1 becomes “non-display.”When the character object CO steps on the third object P1 for the thirdtime, the fourth object W1 is associated with the character objectagain, but an upper limit may be set for the number of times that theobjects can be associated.

As shown in FIG. 45 , for example, in a state in which the fourth objectW11 is associated and displayed by having the character object CO stepon the third object P11, if the character object CO steps on anotherthird object P12, the association of the fourth object W11 is releasedand the fourth object corresponding to another third object P12 isattached.

Alternatively, for example, in a state in which the fourth object W11 isassociated and displayed by having the character object CO step on thethird object P11, if the character object CO steps on another thirdobject P12, the association of the fourth object W11 is not released,and the fourth object W12 corresponding to another third object P12 maybe further attached.

Further, as described above, also when the character object CO moves outof the region and reappears, the association of all the fourth objectsmay be released.

If a display period is not set for the fourth object W1, theconfiguration may be such that the association is not released withoutthe above operations.

When the theme of the world is changed (when the second object S1 ischanged), the third object P1 is changed to another third object P1according to the theme of the world. When there is a plurality of thirdobjects P1, all or part of them may be changed.

Then, even if the theme of the world is changed, the attached fourthobject W1 will continue to be displayed.

Using such a configuration, a mission using the fourth object may begenerated, and a predetermined effect may be generated when the missionis cleared.

An example of a mission is to attach a fourth object that has aspecified relationship to a fourth object that was attached before thetheme was changed, after the theme is changed, and the like. It is alsopossible to continue such a mission over a plurality of theme changes.

For example, in each theme, when a fourth object that is an ice creamobject can be attached, the mission can be to make the head of thecharacter object clog up with ice cream every time the theme is changed.

Predetermined effects include, but are not limited to, displayinganother object, generating a sound effect, and the like. Another objectcan be a production object such as a confetti object, a cracker object,a decorated vessel object, or the like.

Such a predetermined effect can be configured to be magnificent eachtime the theme is changed.

According to the above configuration, the distribution time of the firstuser can be lengthened, and the entertainment of the video can beimproved, so that the viewing motivation of the second user can beimproved.

According to the configuration of the third embodiment, it is possibleto provide a technical improvement that solves or alleviates at leastpart of the above-mentioned problems of the conventional technology.Specifically, according to the above configuration, it is possible toimprove distributing users’ distribution motivation, viewing users’viewing motivation, and/or users’ motivation to interact with eachother.

Fourth Embodiment

Subsequently, various functions that can be executed in the first userterminal 100, the second user terminals 200, and/or the server device400 included in the information processing system 3000 according to afourth embodiment of this disclosure will be described with reference tothe drawings.

As shown in FIG. 46 , one or more computer processors included in theinformation processing system 3000 according to the fourth embodiment ofthis disclosure includes a transmitter 141, a movement operationreceiver 142, a virtual camera controller 143, and a video generator144.

Here, the transmitter 141, the movement operation receiver 142, thevirtual camera controller 143, and the video generator 144 are alldescribed as being provided by the first user terminal 100, but thisdisclosure is not limited thereto.

The transmitter 141 transmits, to the second user terminal 200 of asecond user, information about the video including the character objectof the first user.

As an example, the video can be a video distributed in real time by thefirst user.

As an example, the information regarding the video may be anyinformation that enables the video to be viewed on the second userterminal 200. The rendering of the video may be performed by the firstuser terminal 100 or the server device 400, or may be performed in thesecond user terminal 200.

At least the face of a character object included in the video mayreflect the movement of the face of the first user captured by a cameraprovided in the first user terminal.

The movement operation receiver 142 accepts the movement operation ofthe character object of the first user in the virtual space. The virtualspace can be the space shown in FIG. 22 . The method of accepting themovement operation will be described later.

The virtual camera controller 143 accepts camera operations of a virtualcamera that captures in the virtual space. The method of acceptingcamera operations will be described later.

The video generator 144 generates information for making the characterobject of the first user movable in the virtual space based on themovement operation and the camera operation.

The information generated here is the above-mentioned secondinformation, the above-mentioned video is displayed based on the secondinformation. That is, the video transmitted to the second user terminal200 is the second video.

Then, in this embodiment, a first movement operation is applied to thecharacter object of the first user in response to a predeterminedoperation on a first operation UI displayed on the first user terminal100 of the first user.

Furthermore, a second movement operation is applied to the characterobject of the first user in response to a predetermined operation on asecond operation UI displayed on the first user terminal 100.

Additionally, a viewpoint of the virtual camera can be switched to afirst person viewpoint or a third person viewpoint according to apredetermined operation on a third operation UI displayed on the firstuser terminal 100.

FIG. 47 shows an image in which a first operation UI 51, a secondoperation UI 52, and a third operation UI 53 are displayed on a screenD50 displayed on the first user terminal 100.

The first operation UI 51 is a virtual joystick and can move the targethorizontally in the virtual space according to a swipe direction from aninitial position of a touch in an outer circle region of the firstoperation UI 51. An inner circle in the outer circle region is displayedso as to move in the outer circle region according to the touchposition. A movement speed of the character object may be changedaccording to the moving distance from the initial position. Also, it isacceptable not to change the movement speed of the character objectaccording to the movement distance from the initial position. In thiscase, it is possible to provide an easy-to-see screen with a constantspeed change.

The second operation UI 52 may move the character object vertically inthe virtual space in response to a tap in a circular region of thesecond operation UI 52.

The third operation UI 53 switches between the first-person viewpointand the third-person viewpoint by a tap operation. FIG. 47 is an imageof a screen displaying a video of a third-person viewpoint, and shows animage of a screen displaying a video of the first-person viewpoint ofFIG. 48 .

Then, the virtual camera movement, rotation, and/or scale operations areapplied in response to predetermined operations on a region (fifthregion) in which the first operation UI 51, the second operation UI 52,and the third operation UI 53 are not displayed in the first userterminal 100.

Specifically, the rotation operation is applied to the virtual camera inresponse to a one-finger swipe operation on the fifth region.

Also, the movement operation is applied to the virtual camera inresponse to a two-finger swipe operation on the fifth region.

Further, the scale operation is applied to the virtual camera inresponse to a two-finger pinch-in/pinch-out operation on the fifthregion.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or users’ motivation to interact with each other.

Specifically, the presence of the second video improves the quality ofthe video content.

Furthermore, the above configuration improves the operability of thecharacter object in the second video.

Furthermore, by improving the quality of the video, the viewingmotivation of viewing users is improved, and as the number of viewingusers increases, the distribution motivation of distributing users isalso improved.

Then, as the motivation for distribution and the motivation for viewingare improved, the interaction between distributing users and viewingusers, and further the interaction among viewing users are revitalized.

The virtual space displayed by executing the above-mentioned worldfunction has been described as a space for distributing the second video(world function), but it is not limited to the space for distributingthe second video, and can also be used as a virtual space for aplurality of avatars corresponding to a plurality of users to freelywalk around and communicate with each other.

Additionally, one avatar (one user) among the plurality of avatars inthe virtual space may be configured to be able to distribute the firstvideo as a distributing user. That is, one-to-many video distributioncan be performed in a many-to-many metaverse virtual space.

It is possible to switch whether to display a comment on a videodisplayed on the first user terminal according to a predeterminedoperation on the first user terminal.

FIG. 49 shows a comment field D54 displayed on the screen D50 shown inFIG. 48 .

Furthermore, when the one or more computer processors switch thedisplay/non-display of the comment on the video, the display positionsof the first operation UI and the second operation UI are changed, orthe first operation UI 51, the second operation UI 52, and the thirdoperation UI 53 may not be displayed.

Specifically, the display position is changed in the example shown inFIGS. 48 and 49 , but the first operation UI 51, the second operation UI52, and the third operation UI 53 are not displayed in the example shownin FIGS. 48 and 50 .

Further, as described above, a first movement operation can behorizontal movement (walking or the like), and a second movementoperation can be vertical movement (jumping or the like).

Also, the one or more computer processors apply a rotation operation tothe virtual camera in response to a one-finger swipe operation on theregion (fifth region).

Also, the one or more computer processors apply a movement operation tothe virtual camera in response to a two-finger swipe operation on theregion (fifth region).

Also, the one or more computer processors apply a scale operation to thevirtual camera in response to a two-finger pinch-in/pinch-out operationon the region (fifth region).

By these operations, it becomes possible to freely reflect the inside ofthe virtual space.

The virtual camera controller 143 can accept camera operations from thefirst user or a user authorized by the first user.

The user authorized by the first user can be, for example, one of theguest users, but the details will be described later.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or users’ motivation to interact with each other.

Fifth Embodiment

Subsequently, various functions that can be executed in the first userterminal 100, the second user terminals 200, and/or the server device400 included in the information processing system 3000 according to afifth embodiment of this disclosure will be described with reference tothe drawings.

As shown in FIG. 51 , one or a plurality of computer processors includedin the information processing system 3000 according to the fifthembodiment of this disclosure includes a transmitter 151, a movementoperation receiver 152, a virtual camera controller 153, and a videogenerator 154.

The transmitter 151 transmits, to the second user terminal 200 of asecond user, information about a video including a character object of afirst user. The transmitter 151 can have the same configuration as thetransmitter 141 described above.

The movement operation receiver 152 accepts a movement operation of thecharacter object of the first user in the virtual space. The movementoperation receiver 152 can have the same configuration as the movementoperation receiver 142 described above.

The virtual camera controller 153 accepts camera operations of thevirtual camera that captures in the virtual space. The virtual cameracontroller 153 can have the same configuration as the virtual cameracontroller 143 described above.

The video generator 154 generates information for making the characterobject of the first user movable in the virtual space based on themovement operation and the camera operation. The video generator 154 canhave the same configuration as the video generator 144 described above.

Additionally, the video generator 154 in this disclosure can generateinformation for displaying the character object of one or more otherusers in the video.

The video thus generated is called a collaborative video, and the firstuser is a “host user” and the other users are “guest users.” Details ofthe collaborative video are mentioned above. A viewing user (seconduser) sends a request to participate in the above-mentioned video via acollaborative distribution participation request confirmation screendisplayed by pressing the collaboration request button V15 shown in FIG.12 . The video generator 154 causes the character object of the viewinguser (other user) who made the participation request to be displayed onthe video in response to the participation request received by thereceiver. The character object of the other user may be generated basedon the movement of the other user, or may be based on the operation ofthe other user. Hereinafter, a guest user who is participating in thecollaboration is referred to as an “other user”, and a viewing user whois not participating in the collaboration is referred to as a “seconduser.”

FIG. 52 shows an image of the screen V50 displaying a video in which thecharacter object C1 of the first user (host user) and the characterobjects C2 and C3 of other users (guest users) are displayed.

The display start position of the character object of another user isset to the first region. When the display request is made during thedisplay of the first video, the character objects are displayed in analigned state because all the character objects are in the first region(FIGS. 15 and 16 ). When the display request is made during the displayof the second video, the user other than the other user who made thedisplay request can freely move in the first region or the secondregion, and therefore can be displayed in a scattered state.

If the video is switched to the second video during the collaboration inthe first video, the second video starts from a state in which all thecharacter objects are in the first region. Specifically, in the firstvideo, a virtual camera VC1 that captures a character object from thecenter side of the virtual space is applied (FIG. 24 ), and in thesecond video, a virtual camera VC2 that captures a character object fromthe edge side of the virtual space (the side facing the virtual cameraVC1) is applied (FIG. 25 ). Therefore, at the start of the second video,a video in a state of being captured by the virtual camera VC2 isdisplayed from behind the character object.

Then, the transmitter 151 in this disclosure transmits, to the seconduser terminal 200, a video of the first-person viewpoint or thethird-person viewpoint of the character object C1 of the first user.

Here, the video transmitted to the second user terminal 200 is a secondvideo. That is, the collaborative video in the fifth embodiment is avideo in which the world function is being executed.

FIG. 52 is an example showing a video of the third-person viewpoint ofthe character object C1 of the first user, and the back of the head ofthe character object C1 of the first user and the character objects C2and 3 of another user are displayed. Meanwhile, FIG. 53 is an exampleshowing a video of the first-person viewpoint of the character object C2of another user, and the character object C1 of the first user and thecharacter object C3 of another user are displayed. The positions of thecharacter object and other objects are not related in FIGS. 52 and 53 .

The switching between the first-person viewpoint and the third-personviewpoint can be performed by operating the third operation UI 53 shownin FIG. 47 . Other users can operate their own character object whiletheir own character object participates in the collaboration, and thefirst operation UI 51, the second operation UI 52, and the thirdoperation UI 53 shown on the screen D50 are displayed on the screens oftheir own terminals.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or users’ motivation to interact with each other.

Specifically, by providing the collaboration function also in the secondvideo, the quality of the video as the content is further improved.Also, this leads to revitalization of interaction among usersparticipating in the collaboration, interaction between usersparticipating in the collaboration and viewing users, and furtherinteraction among viewing users.

Furthermore, by improving the quality of the video, the viewingmotivation of viewing users is improved, and as the number of viewingusers increases, the distribution motivation of distributing users isalso improved.

Additionally, the transmitter 151 can transmit, to the second userterminal 200, information about a plurality of videos of thefirst-person viewpoint or the third-person viewpoint of the characterobject of the first user, and the first-person viewpoint or thethird-person viewpoint of the character object of another user.

FIG. 54 shows, as an example, an example in which (i) a display fieldV61 of a video of the third-person viewpoint of the character object C1of the first user, (ii) a display field V62 of a video of thethird-person viewpoint of the character object C2 of another user, and(iii) a display field V63 of a video of the first-person viewpoint ofthe character object C3 of another user are displayed on one screen V60.

(i) Whether to display only the screen of the viewpoint of the characterobject of the first user as in the example shown in FIGS. 52 and 53 , or(ii) whether to display the screens of the viewpoints of the characterobjects of all users in a divided manner as in the example shown in FIG.54 , can be determined by the selection of the first user or the seconduser, as will be described later. In FIG. 54 , there are blanks becausethere are two guests participating in the collaboration, but a thirdguest can be displayed here.

FIG. 54 shows an example in which the display field is equally dividedby quadrangles. The shape of the display field is not particularlylimited, and the size of the display field may be such that the firstuser is large and the other users are small.

FIG. 54 shows a state in which various display and operation UIs are notdisplayed, but as shown in FIGS. 8 and 12 , various display andoperation UIs may be superimposed and displayed.

The screens of the users participating in the collaboration (first userand other users) may display only their own first-person/third-personscreens, respectively. The first/third person screens of all may bedisplayed as shown in FIG. 54 . These may be switchable by the selectionof each user participating in the collaboration.

Additionally, the one or more computer processors in this disclosure mayinclude a selection receiver 155, as shown in FIG. 55 .

The selection receiver 155 accepts the selection of one user from amongthe first user and one or more other users, by the first user or thesecond user.

That is, the first user who is the host user or the second user who isthe viewing user can select one user from among the users participatingin the collaboration.

At this time, the transmitter 151 can transmit information about thevideo according to the selection accepted by the selection receiver 155.

Specifically, when the selection receiver 155 accepts the selection ofone other user from among one or more other users by the first user, thetransmitter 151 transmits information about the first-person viewpointvideo of the one other user.

This assumes, for example, that the character object of the first useris a performer and the other selected user is a cameraman. Normally, thefirst user needs to operate the virtual camera at the same time asoperating his/her own movement and/or the character object. However, inorder to generate a higher quality video, it is easier to delegate theauthority to operate the camera to another user. At this time, since thecharacter object of the selected other user is the staff behind thescenes, the video is automatically set as the first-person view insteadof the third-person view.

When the selection receiver 155 accepts the selection of one user fromthe first user and one or more other users by the second user, thetransmitter 151 may transmit, to the second user terminal, informationabout the video of the first-person viewpoint or the third-personviewpoint of the character object of the selected user.

The screen of the second user may display (i) a video of the viewpointof the character object of the user selected by the user, or (ii) avideo of the viewpoint of the character object of the user having thelargest number of selections (voting) by a plurality of second usersincluding himself/herself and other second users. The type of viewpointdisplayed at this time (first-person viewpoint/third-person viewpoint)may be the type of viewpoint selected by the user who provides the videoof the viewpoint, and may be further selected by the first user or thesecond user.

Further, in the above example, a plurality of second users votes fairly,but the configuration may be such that a specified second user candetermine a video to be displayed to all other second users. Thespecified second user is, for example, (i) a user who has many pointscalculated based on gift display requests, the value of the gifts forwhich the display requests are made, or the like (for example, a userwho has a large gifting amount), (ii) a user who has viewed the videodistributed by the first user many times, or the like.

Further, when the selection receiver 155 accepts the selection of oneother user from among one or more other users by the first user, asshown in FIG. 55 , the one or more computer processors in thisdisclosure may further include a production receiver 156 and an effectgenerator 157.

The production receiver 156 receives a request from other users todisplay a production effect on the video.

The effect generator 157 generates the production effect on the video inresponse to the display request received by the production receiver 156.

As an example, as shown in FIG. 56 , the production effect includes, butis not limited to, displaying another object or generating a soundeffect. The other object can be a production object such as a confettiobject, a cracker object, a decorated vessel object, or the like.

Then, the transmitter 151 transmits information about the video in whichthe production effect is generated.

This assumes, for example, that the character object of the first useris a performer and the other selected user is a special effects staffmember. Normally, the first user needs to perform the operation ofactivating the production effect while performing his/her own movementand/or the operation of the character object. However, in order togenerate a higher quality video, it is easier to delegate the authorityof the activation operation to another user.

Furthermore, when the selection receiver 155 accepts the selection ofone other user from among one or more other users by the first user, theone or more computer processors in this disclosure may further include aswitching receiver 158.

The switch receiver 158 receives a request for switching an object to avideo from another user.

The object switching request is a request to change the above-mentionedsecond object to another second object. In the above example, thecondition for changing the second object is described as the arrival ofa scheduled time, the lapse of a scheduled period, or a changeinstruction from the first user or another user. However, the changeinstruction from another user corresponds to this example.

In response to the switching request received by the switching receiver158, the video generator 154 can change an object other than thecharacter object C1 of the first user and the character object C2 ofanother user displayed in the virtual space to another object (FIGS. 57and 58 ).

As shown in FIGS. 57 and 58 , there may be objects that are partiallyunchanged (tower cake objects, or the like).

When the viewing user requests the display of an attached gift, adisplay instruction object for displaying a gift object corresponding tothe attached gift in a video in response to such a display request maybe displayed on the screen of one other user whose selection by thefirst user or the second user is accepted by the selection receiver 155.This allows other users to cause the first user (or a guest user otherthan other users) to wear and display the attached gift object at theirown preferred timing.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or the users’ motivation to interact with each other.

The first to fifth embodiments described above can be combined with eachother, or some of these embodiments can be combined with each other.

Subsequently, an information processing method in the embodiment of thisdisclosure will be described.

The information processing method in the embodiment of this disclosureis the information processing method in the information processingsystem 3000 shown in FIG. 3 . The information processing system 3000includes one or more first user terminals 100, the second user terminals200, and the server device 400.

In an information processing method in this disclosure, as shown as anexample in FIG. 59 , one or more computer processors included in theinformation processing system 3000 are caused to execute stepsS431-S437.

Step S431 transmits, to the second user terminal 200 of a second user,information about a video including a character object of a first user.Step S431 can be executed by the transmitter 431 described above.

Step S431 may be executed at the server side (server device 400) or maybe executed at the client side (first user terminal 100).

Step S432 receives a display request for a first object from the seconduser terminal 200. The step S432 can be executed by the receiver 432described above.

Step S432 may be executed at the server side (server device 400) or maybe executed at a client side (first user terminal 100).

Step S433 generates first information for displaying, as a first video,the character object of the first user and the first object in a firstregion in a virtual space. The step S433 can be executed by the firstvideo generator 433 described above.

Step S433 may be executed at the server side (server device 400) or maybe executed at the client side (first user terminal 100).

Step S434 generates second information for (i) causing a second objectdifferent from the first object, and a third object different from thefirst object and the second object, to be displayed in a second regionin the virtual space, as a second video, and (ii) displaying thecharacter object of the first user so as to be movable in the firstregion and the second region. The step 434 can be executed by the secondvideo generator 434 described above.

Step S434 may be executed at the server side (server device 400) or maybe executed at the client side (first user terminal 100).

When the character object of the first user and the third object have apredetermined relationship (YES in step S435), step S436 associates,with the character object of the first user, a fourth object associatedwith the third object. The steps S435 and S436 can be executed by theassociation section 435 described above.

Steps S435 and S436 may be executed at the server side (server device400) or at the client side (first user terminal 100).

Then, in step S437, when the fourth object is associated with thecharacter object of the first user in step S436, the fourth object isdisplayed in association with the character object of the first user.The step S437 can be executed by the second video generator 434described above.

Step S437 may be executed at the server side (server device 400) or maybe executed at the client side (first user terminal 100).

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or users’ motivation to interact with each other.

Next, a computer program according to an embodiment of this disclosurewill be described.

As shown in FIG. 3 , a computer program according to an embodiment ofthis disclosure is a computer program executed by the informationprocessing system 3000 that distributes videos. The informationprocessing system 3000 includes one or more first user terminals 100,the second user terminals 200, and the server device 400.

A computer program in this disclosure causes one or more computerprocessors provided with the information processing system 3000 torealize a transmission function, a reception function, a first videogeneration function, a second video generation function, and anassociation function.

The transmission function transmits, to the second user terminal 200 ofa second user, information about a video including a character object ofa first user.

The reception function receives, from the second user terminal 200, adisplay request for a first object.

The first video generation function generates first information fordisplaying the character object of the first user and the first objectin the first region in a virtual space, as a first video.

The second video generation function generates a second information for(i) causing a second object different from the first object, and a thirdobject different from the first object and the second object, to bedisplayed in a second region in the virtual space, as a second video,and (ii) displaying the character object of the first user so as to bemovable in the first region and the second region.

The association function associates, with the character object of thefirst user, a fourth object associated with the third object, when thecharacter object of the first user and the third object have apredetermined relationship.

Then, when the fourth object is associated with the character object ofthe first user by the association function, the second video generationfunction displays the fourth object in association with the characterobject of the first user.

The above functions can be realized by a transmission circuit 1431, areception circuit 1432, a first video generation circuit 1433, a secondvideo generation circuit 1434, and an association circuit 1435 that areshown in FIG. 60 . The transmission circuit 1431, the reception circuit1432, the first video generation circuit 1443, the second videogeneration circuit 1434, and the association circuit 1435 are realizedby the transmitter 431, the receiver 432, the first video generator 433,the second video generator 434, and the association portion 435described above, respectively. Details of each component are asdescribed above.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or users’ motivation to interact with each other.

Next, an information processing device according to an embodiment ofthis disclosure will be described. The information processing devicecorresponds to the first user terminal 100 in the information processingsystem 3000 described above.

As shown in FIG. 61 , the information processing device includes atransmitter 131, a first video generator 132, a second video generator133, and an association portion 134.

The transmitter 131 transmits, to the server device 400, informationabout a video including a character object of a first user.

The first video generator 132 generates first information fordisplaying, as a first video, the character object of the first user anda first object for which a display request has been made from a seconduser terminal, in a first region in a virtual space. The first videogenerator 132 can have the same configuration as the first videogenerator 433 described above.

The second video generator 133 generates second information for (i)causing a second object different from the first object, and a thirdobject different from the first object and the second object to bedisplayed in a second region in the virtual space, as a second video,and (ii) displaying the character object of the first user so as to bemovable in the first region and the second region. The second videogenerator 133 may have the same configuration as the second videogenerator 434 described above.

The association portion 134 associates, with the character object of thefirst user, a fourth object associated with the third object, when thecharacter object of the first user and the third object have apredetermined relationship. The association portion 134 may have thesame configuration as the association portion 435 described above.

When the fourth object is associated with the character object of thefirst user by the association portion 134, the second video generator133 displays the fourth object in association with the character objectof the first user.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or users’ motivation to interact with each other.

Next, an information processing method in an embodiment of thisdisclosure will be described. The information processing method is aninformation processing method executed by the information processingdevice (first user terminal 100) described above.

As shown in FIG. 62 as an example, an information processing method inthis disclosure causes one or more computer processors provided with theinformation processing device to execute steps S131-136.

Step S131 transmits, to the server device 400, information about a videoincluding a character object of a first user. The step S131 can beexecuted by the transmitter 131 described above.

Step S132 generates first information for causing the character objectof the first user and a first object for which a display request hasbeen made from a second user terminal to be displayed in a first regionin a virtual space, as a first video. The step S132 can be executed bythe first video generator 132 described above.

Step S133 generates second information for (i) displaying, as a secondvideo, a second object different from the first object, and a thirdobject different from the first object and the second object, in asecond region in the virtual space, and (ii) displaying the characterobject of the first user so as to be movable in the first region and thesecond region. The step S133 can be executed by the second videogenerator 133 described above.

When the character object of the first user and the third object have apredetermined relationship (YES in step S134), step S135 associates,with the character object of the first user, a fourth object associatedwith the third object.

When the fourth object is associated with the character object of thefirst user in step S135, step S136 displays the fourth object inassociation with the character object of the first user.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or users’ motivation to interact with each other.

Next, a computer program according to an embodiment of this disclosurewill be described. The computer program is a computer program executedin the information processing device (first user terminal 100) describedabove.

A computer program in this disclosure causes one or more computerprocessors provided with the information processing system to realize atransmission function, a first video generation function, a second videogeneration function, and an association function.

The transmission function transmits, to the server device 400,information about a video including a character object of a first user.

The first video generation function generates first information forcausing the character object of the first user and a first object forwhich a display request has been made from the second user terminal 200to be displayed in the first region in the virtual space, as a firstvideo.

The second video generation function generates second information for(i) causing a second object different from the first object, and thethird object different from the first object and the second object, tobe displayed in a second region in the virtual space, as a second video,and (ii) displaying the character object of the first user so as to bemovable in the first region and the second region.

When the character object of the first user and the third object have apredetermined relationship, the association function associates, withthe character object of the first user, a fourth object associated withthe third object.

When the fourth object is associated with the character object of thefirst user by the association function, the second video generationfunction displays the fourth object in association with the characterobject of the first user.

The above functions can be realized by a transmission circuit 1131, afirst video generation circuit 1132, a second video generation circuit1133, and an association circuit 1134 that are shown in FIG. 63 . Thetransmission circuit 1131, the first video generation circuit 1132, thesecond video generation circuit 1133, and the association circuit 1134are realized by the transmitter 131, the first video generator 132, thesecond video generator 133, and the association portion 134 describedabove, respectively. Details of each component are as described above.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or users motivation’ to interact with each other.

Next, an information processing device according to an embodiment ofthis disclosure will be described. The information processing devicecorresponds to the second user terminal 200 in the informationprocessing system 3000 described above.

As shown in FIG. 64 , the information processing device includes areceiver 231, a transmitter 232, and a display portion 233.

The receiver 231 receives, from the server device 400, information abouta video including a character object of a first user.

The transmitter 232 transmits, to the server device 400, a displayrequest for a first object.

The display portion 233 (i) displays, as a first video, the characterobject of the first user and the first object in the first region in avirtual space, (ii) displays, as a second video, a second objectdifferent from the first object, and the third object different from thefirst object and the second object, in a second region in the virtualspace, and (iii) displays the character object of the first user so asto be movable in the first region and the second region.

When the character object of the first user and the third object have apredetermined relationship, the display portion 233 displays thecharacter object of the first user in association with a fourth object.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or users’ motivation to interact with each other.

Next, an information processing method in an embodiment of thisdisclosure will be described. The information processing method is aninformation processing method executed by the information processingdevice (second user terminal 200) described above.

As shown in FIG. 65 as an example, an information processing method inthis disclosure causes one or more computer processors provided with theinformation processing device to execute steps S231 to S233.

The reception step S231 receives, from the server device 400,information about a video including a character object of a first user.The reception step S231 can be executed by the receiver 231 describedabove.

The transmission step S232 transmits, to the server device 400, adisplay request for a first object. The transmission step S232 can beexecuted by the transmitter 232 described above.

The display step S233 (i) displays, as a first video, the characterobject of the first user and a first object in the first region in thevirtual space, (ii) displays, as a second video, a second objectdifferent from the first object, and the third object different from thefirst object and the second object,, in a second region in the virtualspace, and (iii) displays the character object of the first user so asto be movable in the first region and the second region. The displaystep S233 can be executed by the display portion 233 described above.

When the character object of the first user and the third object have apredetermined relationship, the display step S233 displays the characterobject of the first user in association with a fourth object associatedwith the third object.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or users’ motivation to interact with each other.

A computer program according to an embodiment of this disclosure will bedescribed. The computer program is a computer program executed by theinformation processing device (second user terminal 200) describedabove.

A computer program in this disclosure causes one or more processorsincluded in an information processing system to realize a receptionfunction, a transmission function, and a display function.

The reception function receives, from the server device 400, informationabout a video including a character object of a first user.

The transmission function transmits, to the server device 400, a displayrequest for a first object.

The display function (i) displays, as a first video, the characterobject of the first user and the first object in a first region in avirtual space, (ii) displays, as a second video, a second objectdifferent from the first object, and the third object different from thefirst object and the second object, in a second region in the virtualspace, and (iii) displays the character object of the first user so asto be movable in the first region and the second region.

When the character object of the first user and the third object have apredetermined relationship, the display function displays the characterobject of the first user in association with a fourth object associatedwith the third object.

The above functions can be realized by a reception circuit 1231, atransmission circuit 1232, and a display circuit 1233 that are shown inFIG. 66 . The reception circuit 1231, the transmission circuit 1232, andthe display circuit 1233 are realized by the receiver 231, thetransmitter 232, and the display portion 233 described above,respectively. Details of each component are as described above.

Alternative configurations of this disclosure include the following

Alternative Configurations of this Disclosure Include the Following

An information processing method in this disclosure causes one or morecomputer processors provided with the information processing system 3000to perform a transmission step S441, a movement operation reception stepS442, a virtual camera control step (receive camera operation step)S443, and a video generation step S444, as shown in FIG. 67 , as anexample.

The transmission step S441 transmits, to the second user terminal 200 ofa second user, information about a video including a character object ofa first user. Such transmission step S441 can be executed by thetransmitter 141 described above.

The transmission step S441 may be executed at the server side (serverdevice 400) or may be executed at the client side (first user terminal100).

The movement operation reception step S442 accepts a movement operationof the character object of the first user in the virtual space. Themovement operation reception step S442 can be executed by the movementoperation receiver 142 described above.

The movement operation reception step S442 may be executed at the serverside (server device 400) or may be executed at the client side (firstuser terminal 100).

The virtual camera control step S443 accepts camera operations of avirtual camera that captures in the virtual space. The virtual cameracontrol step S443 can be executed by the virtual camera controller 143described above.

The virtual camera control step S443 may be executed at the server side(server device 400) or may be executed at the client side (first userterminal 100).

The video generation step S444 generates information for making thecharacter object of the first user movable in the virtual space based onthe movement operation and the camera operation. The video generationstep S444 can be executed by the video generator 144 described above.

The video generation step S444 may be executed at the server side(server device 400) or may be executed at the client side (first userterminal 100).

In the video generation step S444, (i) a first movement operation isapplied to the character object of the first user in response to apredetermined operation on a first operation UI displayed on the firstuser terminal 100 of the first user, (ii) a second movement operation isapplied to the character object of the first user in response to apredetermined operation on a second operation UI displayed on the firstuser terminal, (iii) the viewpoint of the virtual camera is switched tothe first-person or third-person viewpoint in response to apredetermined operation on a third operation UI displayed on the firstuser terminal, and (iv) virtual camera movement, rotation and/or scaleoperations are applied in response to predetermined operations on aregion where the first operation UI, the second operation UI, and thethird operation UI are not displayed on the first user terminal.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or users’ motivation to interact with each other.

Subsequently, a computer program according to an embodiment of thisdisclosure will be described.

As shown in FIG. 3 , a computer program according to an embodiment ofthis disclosure is a computer program executed by the informationprocessing system 3000 that distributes videos. The informationprocessing system 3000 includes one or more first user terminals 100,the second user terminals 200, and the server device 400.

The computer program in this disclosure causes one or more computerprocessors provided with the information processing system 3000 torealize a transmission function, a movement operation receptionfunction, a virtual camera control function, and a video generationfunction.

The transmission function transmits, to the second user terminal 200 ofa second user, information about a video including a character object ofthe first user.

The movement operation reception function accepts a movement operationof the character object of the first user in the virtual space.

The virtual camera control function accepts a camera operation of thevirtual camera that captures in the virtual space.

The video generation function generates information for making thecharacter object of the first user movable in the virtual space based onthe movement operation and the camera operation.

In the video generation function, (i) a first movement operation isapplied to the character object of a first user in response to apredetermined operation on a first operation UI displayed on the firstuser terminal 100 of the first user, (ii) a second movement operation isapplied to the character object of the first user in response to apredetermined operation on a second operation UI displayed on the firstuser terminal, (iii) the viewpoint of the virtual camera is switched tothe first-person or third-person viewpoint in response to apredetermined operation on a third operation UI displayed on the firstuser terminal, and (iv) virtual camera movement, rotation and/or scaleoperations are applied in response to predetermined operations on aregion where the first operation UI, the second operation UI, and thethird operation UI are not displayed on the first user terminal.

The above functions can be realized by a transmission circuit 1441, amovement operation reception circuit 1432, a virtual camera controlcircuit 1443, and a video generation circuit 1444 that are shown in FIG.68 . The transmission circuit 1441, the movement operation receptioncircuit 1432, the virtual camera control circuit 1443, and the videogeneration circuit 1444 are realized by the transmitter 141, themovement operation receiver 142, the virtual camera controller 143, andthe video generator 144 described above, respectively. The details ofeach part are as described above.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or the users’ motivation to interact with each other.

Subsequently, an information processing device according to anembodiment of this disclosure will be described. The informationprocessing device corresponds to the first user terminal 100 in theabove-mentioned information processing system 3000.

As shown in FIG. 46 , the information processing device includes thetransmitter 141, the movement operation receiver 142, the virtual cameracontroller 143, and the video generator 144.

The transmitter 141 transmits, to the server device, information about avideo including a character object of a first user. The details of thetransmitter 141 are as described above.

The movement operation receiver 142 accepts a movement operation of thecharacter object of the first user in the virtual space. The details ofthe transmitter 141 are as described above.

The virtual camera controller 143 accepts a camera operation of thevirtual camera that captures in the virtual space. The details of thevirtual camera controller 143 are as described above.

The video generator 144 generates information for making the characterobject of the first user movable in the virtual space based on themovement operation and the camera operation. The details of the videogenerator 144 are as described above.

(i) A first movement operation is applied to the character object of thefirst user in response to a predetermined operation on a first operationUI displayed on the first user terminal 100 of the first user, (ii) asecond movement operation is applied to the character object of thefirst user in response to a predetermined operation on a secondoperation UI displayed on the first user terminal, (iii) the viewpointof the virtual camera is switched to the first-person or third-personviewpoint in response to a predetermined operation on a third operationUI displayed on the first user terminal, and (iv) virtual cameramovement, rotation and/or scale operations are applied in response topredetermined operations on the region where the first operation UI, thesecond operation UI, and the third operation UI are not displayed on thefirst user terminal.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or users’ motivation to interact with each other.

Subsequently, an information processing method in an embodiment of thisdisclosure will be described. Such an information processing method isan information processing method executed by the above-mentionedinformation processing device (first user terminal 100).

As shown in FIG. 69 as an example, an information processing method inthis disclosure causes one or more computer processors provided with theinformation processing device to execute a transmission step S141, amovement operation reception step S142, a virtual camera control step(receive camera operation step) S143, and a video generation step S144.

The transmission step S141 transmits, to the server device 400,information about a video including a character object of a first user.The transmission step S141 can be executed by the transmitter 141described above.

The movement operation reception step S142 accepts a movement operationof the character object of the first user in the virtual space. Themovement operation reception step S142 can be executed by the movementoperation receiver 142 described above.

The virtual camera control step S143 accepts a camera operation of avirtual camera that captures in the virtual space. The virtual cameracontrol step S143 can be executed by the virtual camera controller 143described above.

The video generation step S144 generates information for making thecharacter object of the first user movable in the virtual space based onthe movement operation and the camera operation. The video generationstep S144 can be executed by the video generator 144 described above.

In the video generation step S144, (i) a first movement operation isapplied to the character object of the first user in response to apredetermined operation on a first operation UI displayed on the firstuser terminal 100 of the first user, (ii) a second movement operation isapplied to the character object of the first user in response to apredetermined operation on a second operation UI displayed on the firstuser terminal, (iii) the viewpoint of the virtual camera is switched tothe first-person or third-person viewpoint in response to apredetermined operation on a third operation UI displayed on the firstuser terminal 100, and (iv) virtual camera movement, rotation and/orscale operations are applied in response to predetermined operations onthe region where the first operation UI, the second operation UI, andthe third operation UI are not displayed on the first user terminal.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or users’ motivation to interact with each other.

Subsequently, a computer program according to an embodiment of thisdisclosure will be described. The computer program is a computer programexecuted in the above-mentioned information processing device (firstuser terminal 100).

The computer program in this disclosure causes one or more processorsprovided with the information processing system to realize atransmission function, a movement operation reception function, avirtual camera control function, and a video generation function.

The transmission function transmits, to the server device 400,information about a video including a character object of a first user.

The movement operation reception function accepts a movement operationof the character object of the first user in a virtual space.

The virtual camera control function accepts a camera operation of avirtual camera that captures in the virtual space.

The video generation function generates information for making thecharacter object of the first user movable in the virtual space based onthe movement operation and the camera operation.

The video generation function (ii) applies a first movement operation tothe character object of the first user in response to a predeterminedoperation on a first operation UI displayed on the first user terminal100 of the first user, (ii) applies a second movement operation to thecharacter object of the first user in response to a predeterminedoperation on a second operation UI displayed on the first user terminal100, (iii) switches the viewpoint of the virtual camera to thefirst-person or third-person viewpoint in response to a predeterminedoperation on a third operation UI displayed on the first user terminal100, and (iv) applies virtual camera movement, rotation and/or scaleoperations in response to predetermined operations on a region where thefirst operation UI, the second operation UI, and the third operation UIare not displayed on the first user terminal.

The above functions can be realized by a transmission circuit 1441, amovement operation reception circuit 1142, a virtual camera controlcircuit 1143, and a video generation circuit 1144 that are shown in FIG.70 . The transmission circuit 1141, the movement operation receptioncircuit 1142, the virtual camera control circuit 1143, and the videogeneration circuit 1144 are realized by the transmitter 141, themovement operation receiver 142, the virtual camera controller 143, andthe video generator 144 described above, respectively. The details ofeach part are as described above.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or users’ motivation to interact with each other.

Subsequently, an information processing device according to anembodiment of this disclosure will be described. The informationprocessing device is the second user terminal 200 in the informationprocessing system 3000 described above, and corresponds to the seconduser terminal 200 of a second user who is the guest user describedabove.

As shown in FIG. 71 , the information processing device includes areceiver 241, a movement operation receiver 242, a virtual cameracontroller 243, a transmitter 244, and a display portion 245.

The receiver 241 receives, from the server device 400, information abouta video including a character object of a first user and a characterobject of a second user.

The movement operation receiver 242 accepts a movement operation of thecharacter object of the second user in the virtual space.

The virtual camera controller 243 accepts a camera operation of thevirtual camera that captures in the virtual space.

The transmitter 244 transmits, to the server device 400, informationabout the movement operation and the camera operation.

The display portion 245 displays the character object of the first userand the character object of the second user so as to be movable in thevirtual space.

(i) A first movement operation is applied to the character object of thesecond user in response to a predetermined operation on a firstoperation UI displayed on the second user terminal 200 of the seconduser, (ii) a second movement operation is applied to the characterobject of the first user in response to a predetermined operation on asecond operation UI displayed on the second user terminal 200, (iii) theviewpoint of the virtual camera is switched to the first-person orthird-person viewpoint in response to a predetermined operation on athird operation UI displayed on the second user terminal 200, and (iv)virtual camera movement, rotation and/or scale operations are applied inresponse to predetermined operations on a region where the firstoperation UI, the second operation UI, and the third operation UI arenot displayed on the second user terminal 200.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or users’ motivation to interact with each other.

Subsequently, an information processing method in an embodiment of thisdisclosure will be described. The information processing method is aninformation processing method executed in the above-mentionedinformation processing device (second user terminal 200).

As shown in FIG. 72 as an example, an information processing method inthis disclosure causes one or more computer processors provided with theinformation processing device to execute a receiving step S241, amovement operation reception step S242, a virtual camera control step(receive camera operation step) S243, a transmission step S244, and adisplay step S245.

The reception step S241 receives, from the server device 400,information about a video including a character object of a first userand a character object of a second user. The reception step S241 can beexecuted by the receiver 241 described above.

The movement operation reception step S242 accepts a movement operationof the character object of the second user in the virtual space. Themovement operation reception step S242 can be executed by the movementoperation receiver 242 described above.

The virtual camera control step S243 accepts a camera operation of avirtual camera that captures in the virtual space. The virtual cameracontrol step S243 can be executed by the virtual camera controller 243described above.

The transmission step S244 transmits, to the server device 400,information about the movement operation and the camera operation. Thetransmission step S244 can be executed by the transmitter 244 describedabove.

The display step S245 displays the character object of the first userand the character object of the second user so as to be movable in thevirtual space. The display step S245 can be executed by the displayportion 245 described above.

(i) A first movement operation is applied to the character object of thesecond user in response to a predetermined operation on a firstoperation UI displayed on the second user terminal 200 of a second user,(ii) a second movement operation is applied to the character object ofthe first user in response to a predetermined operation on a secondoperation UI displayed on the second user terminal 200, (iii) theviewpoint of the virtual camera is switched to the first-person orthird-person viewpoint in response to a predetermined operation on athird operation UI displayed on the second user terminal 200, and (iv)virtual camera movement, rotation and/or scale operations are applied inresponse to predetermined operations on a region where the firstoperation UI, the second operation UI, and the third operation UI arenot displayed on the second user terminal 200.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or users’ motivation to interact with each other.

A computer program according to an embodiment of this disclosure will bedescribed. The computer program is a computer program executed by theabove-mentioned information processing device (second user terminal200).

A computer program in this disclosure causes one or more processorsprovided with the information processing system to realize a receivingfunction, a movement operation reception function, a virtual cameracontrol function, a transmission function, and a display function.

The receiving function receives, from the server device 400, informationabout a video including a character object of a first user and acharacter object of a second user.

The movement operation reception function accepts a movement operationof the character object of the second user in the virtual space.

The virtual camera control function accepts a camera operation of avirtual camera that captures in the virtual space.

The transmission function transmits, to the server device 400,information about the movement operation and the camera operation.

The display function displays the character object of the first user andthe character object of the second user so as to be movable in thevirtual space.

(i) A first movement operation is applied to the character object of thesecond user in response to a predetermined operation on a firstoperation UI displayed on the second user terminal 200 of the seconduser, (ii) a second movement operation is applied to the characterobject of the first user in response to a predetermined operation on asecond operation UI displayed on the second user terminal 200, (iii) theviewpoint of the virtual camera is switched to the first-person orthird-person viewpoint in response to a predetermined operation on athird operation UI displayed on the second user terminal 200, and (iv)virtual camera movement, rotation and/or scale operations are applied inresponse to predetermined operations on a region where the firstoperation UI, the second operation UI, and the third operation UI arenot displayed on the second user terminal 200.

The above functions can be realized by a reception circuit 1241, amovement operation reception circuit 1242, a virtual camera controlcircuit 1243, a transmission circuit 1244, and a display circuit 1245that are shown in FIG. 73 . The reception circuit 1241, the movementoperation reception circuit 1242, the virtual camera control circuit1243, the transmission circuit 1244, and the display circuit 1245 can berealized by the receiver 241, the movement operation receiver 242, thevirtual camera controller 243, the transmitter 244, and the displayportion, respectively. The details of each part are as described above.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or users’ motivation to interact with each other.

Alternative Configurations of this Disclosure Include the Following

As shown in FIG. 74 as an example, an information processing method inthis disclosure causes one or more computer processors provided with theinformation processing system 3000 to execute a transmission step S451,a movement operation reception step S452, a virtual camera control stepS453, and a video generation step S454.

The transmission step S451 transmits, to a second user terminal of asecond user, information about a video including a character object of afirst user. The transmission step S451 can be executed by thetransmitter 151 described above.

The transmission step S451 may be executed at the server side (serverdevice 400) or may be executed at the client side (first user terminal100).

The movement operation reception step S452 accepts a movement operationof the character object of the first user in a virtual space. Themovement operation reception step S452 can be executed by the movementoperation receiver 152 described above.

The movement operation reception step S452 may be executed at the serverside (server device 400) or may be executed at the client side (firstuser terminal 100).

The virtual camera control step S453 accepts a camera operation of avirtual camera that captures in the virtual space. The virtual cameracontrol step S453 can be executed by the virtual camera controller 153described above.

The virtual camera control step S453 may be executed at the server side(server device 400) or may be executed at the client side (first userterminal 100).

The video generation step S454 generates information for making thecharacter object of the first user movable in the virtual space, basedon the movement operation and the camera operation. The video generationstep S454 can be executed by the video generator 154 described above.

The video generation step S454 may be executed at the server side(server device 400) or may be executed at the client side (first userterminal 100).

Then, in the video generation step S454, it is possible to generateinformation for displaying, in a video, a character object of one ormore other users. In the transmission step S451, information about (i) avideo of a first-person viewpoint or a third-person viewpoint of thecharacter object of the first user, (ii) a video of the first-personviewpoint or the third-person viewpoint of the character object of oneother user from among the one or more other users, or (iii) a pluralityof videos of (a) the first-person viewpoint or the third-personviewpoint of the character object of the first user, and (b) thefirst-person viewpoint or the third-person viewpoint of the characterobject of another user, is transmitted to a second user terminal.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or users’ motivation to interact with each other.

Next, a computer program according to an embodiment of this disclosurewill be described.

As shown in FIG. 3 , the computer program according to an embodiment ofthis disclosure is a computer program executed by the informationprocessing system 3000 that distributes videos. The informationprocessing system 3000 includes one or more first user terminals 100,second user terminals 200, and a server device 400.

A computer program in this disclosure causes one or more computerprocessors provided with the information processing system 3000 torealize a transmission function, a movement operation receptionfunction, a virtual camera control function, and a video generationfunction.

The transmission function transmits, to the second user terminal of asecond user, information about a video including a character object of afirst user.

The movement operation reception function accepts a movement operationof the character object of the first user in a virtual space.

The virtual camera control function accepts a camera operation of avirtual camera that captures in the virtual space.

The video generation function generates information for making thecharacter object of the first user movable in the virtual space, basedon the movement operation and the camera operation.

Then, in the video generation function, it is possible to generateinformation for displaying, in the video, a character object of one ormore other users. The transmission function transmits, to the seconduser terminal, information about (i) a video of a first-person viewpointor a third-person viewpoint of the character object of the first user,(ii) a video of the first-person viewpoint or the third-person viewpointof the character object of one other user from among the one or moreother users, or (iii) a plurality of videos of (a) the first-personviewpoint or the third-person viewpoint of the character object of thefirst user, and (b) the first-person viewpoint or the third-personviewpoint of the character object of another user.

The above functions can be realized by a transmission circuit 1451, amovement operation reception circuit 1452, a virtual camera controlcircuit 1453, and a video generation circuit 1454 that are shown in FIG.75 . The transmission circuit 1451, the movement operation receptioncircuit 1452, the virtual camera control circuit 1453, and the videogeneration circuit 1454 are realized by the transmitter 151, themovement operation receiver 152, the virtual camera controller 153, andthe video generator 154 described above, respectively. Details of eachcomponent are as described above.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or users’ motivation to interact with each other.

Next, an information processing device according to an embodiment ofthis disclosure will be described. The information processing devicecorresponds to the first user terminal 100 in the above-mentionedinformation processing system 3000.

As shown in FIG. 76 , the information processing device is provided witha transmitter 151, a movement operation receiver 152, a virtual cameracontroller 153, a video generator 154, a receiver 159, and a displayportion 160.

The transmitter 151 transmits, to the server device, information about avideo including a character object of a first user. Details of thetransmitter 151 are as described above.

The movement operation receiver 152 accepts a movement operation of thecharacter object of the first user in a virtual space. Details of thetransmitter 151 are as described above.

The virtual camera controller 153 accepts a camera operation of avirtual camera that captures in the virtual space. Details of thevirtual camera controller 153 are as described above.

The video generator 154 generates information for making the characterobject of the first user movable in the virtual space, based on themovement operation and the camera operation. Details of the videogenerator 154 are as described above.

The receiver 159 receives, from the server device 400, information fordisplaying a character object of one or more other users in the video.

The display portion 160 displays (i) a video of a first-person viewpointor a third-person viewpoint of the character object of the first user,(ii) a video of the first-person viewpoint or the third-person viewpointof a character object of one other user from among the one or more otherusers, or (iii) a plurality of videos of (a) the first-person viewpointor the third-person viewpoint of the character object of the first user,and (b) the first-person viewpoint or the third-person viewpoint of thecharacter object of another user.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or users’ motivation to interact with each other.

Next, an information processing method in an embodiment of thisdisclosure will be described. The information processing method is aninformation processing method executed by the information processingdevice (first user terminal 100) described above.

As shown in FIG. 77 as an example, an information processing method inthis disclosure causes one or more computer processors provided with theinformation processing device to execute a transmission step S151, amovement operation reception step S152, a virtual camera control stepS153, a video generation step S154, a reception step S159, and a displaystep S160.

The transmission step S151 transmits, to the server device, informationabout a video including a character object of a first user. Thetransmission step S151 can be executed by the transmitter 151 describedabove.

The movement operation reception step S152 accepts a movement operationof the character object of the first user in a virtual space. Themovement operation reception step S152 can be executed by the movementoperation receiver 152 described above.

The virtual camera control step S153 accepts a camera operation of avirtual camera that captures in the virtual space. The virtual cameracontrol step S153 can be executed by the virtual camera controller 153described above.

The video generation step S154 generates information for making thecharacter object of the first user movable in the virtual space based onthe movement operation and the camera operation. The video generationstep S154 can be executed by the video generator 154 described above.

The reception step S159 receives information for causing a characterobject of one or more other users to be displayed in the video. Thereception step S159 can be executed by the receiver 159 described above.

The display step S160 displays (i) a video of a first-person viewpointor a third-person viewpoint of the character object of the first user,(ii) a video of the first-person viewpoint or the third-person viewpointof the character object of one other user from among the one or moreother users, or (iii) a plurality of videos of (a) the first-personviewpoint or the third-person viewpoint of the character object of thefirst user, and (b) the first-person viewpoint or the third-personviewpoint of the character object of another user. The display step S160can be executed by the display portion 160 described above.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or users’ motivation to interact with each other.

Next, a computer program according to an embodiment of this disclosurewill be described. The computer program is a computer program executedby the information processing device (first user terminal 100) describedabove.

A computer program in this disclosure causes one or more processorsprovided with the information processing system to realize atransmission function, a movement operation reception function, avirtual camera control function, a video generation function, areception function, and a display function.

The transmission function transmits, to a server device, informationabout a video including a character object of a first user.

The movement operation reception function accepts a movement operationof the character object of the first user in a virtual space.

The virtual camera control function accepts a camera operation of avirtual camera that captures in the virtual space.

The video generation function generates information for making thecharacter object of the first user movable in the virtual space, basedon the movement operation and the camera operation.

The reception function receives, from the server device, information forcausing the character object of one or more other users to be displayedin the video.

The display function displays (i) a video of a first-person viewpoint ora third-person viewpoint of the character object of the first user, (ii)a video of the first-person viewpoint or the third-person viewpoint ofthe character object of one other user from among the one or more otherusers, or (iii) a plurality of videos of (a) the first-person viewpointor the third-person viewpoint of the character object of the first user,and (b) the first-person viewpoint or the third-person viewpoint of thecharacter object of another user.

The above functions can be realized by a transmission circuit 1151, amovement operation reception circuit 1152, a virtual camera controlcircuit 1153, a video generation circuit 1154, a reception circuit 1155,and a display circuit 1156 that are shown in FIG. 78 . The transmissioncircuit 1151, the movement operation reception circuit 1152, the virtualcamera control circuit 1153, the video generation circuit 1154, thereception circuit 1155, and the display circuit 1156 are realized by thetransmitter 151, the movement operation receiver 152, the virtual cameracontroller 153, the video generator 154, the receiver 159, and thedisplay portion 160 described above, respectively. Details of eachcomponent are as described above.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or users’ motivation to interact with each other.

Next, an information processing device according to an embodiment ofthis disclosure will be described. The information processing device isthe second user terminal 200 in the information processing system 3000described above, and corresponds to the second user terminal 200 of asecond user who is the guest user described above.

As shown in FIG. 79 , the information processing device includes areceiver 251, a movement operation receiver 252, a virtual cameracontroller 253, a transmitter 254, and a display portion 255.

The receiver 251 receives, from the server device, information about avideo including a character object of a first user and a characterobject of a second user.

The movement operation receiver 252 accepts a movement operation of thecharacter object of the second user in a virtual space.

The virtual camera controller 253 accepts a camera operation of avirtual camera that captures in the virtual space.

The transmitter 254 transmits, to a server device, information about themovement operation and the camera operation.

The display portion 255 displays the character object of the first userand the character object of the second user so as to be movable in thevirtual space.

The display portion 255 displays (i) a video of a first-person viewpointor a third-person viewpoint of the character object of the first user,(ii) a video of the first-person viewpoint or the third-person viewpointof the character object of the second user, or (iii) a plurality ofvideos of (a) the first-person viewpoint or the third-person viewpointof the character object of the first user, and (b) the first-personviewpoint or the third-person viewpoint of the character object of thesecond user.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or users’ motivation to interact with each other.

Next, an information processing method in an embodiment of thisdisclosure will be described. The information processing method is aninformation processing method executed by the information processingdevice (second user terminal 200) described above.

As shown in FIG. 80 as an example, an information processing method inthis disclosure causes one or more computer processors provided with theinformation processing device to execute a reception step S251, amovement operation reception step S252, a virtual camera control stepS253, a transmission step S254, and a display step S255.

The reception step S251 receives, from a server device, informationabout a video including a character object of a first user and acharacter object of a second user. The reception step S251 can beexecuted by the receiver 251 described above.

The movement operation reception step S252 accepts a movement operationof the character object of the second user in the virtual space. Themovement operation reception step S252 can be executed by the movementoperation receiver 252 described above.

The virtual camera control step S253 accepts a camera operation of avirtual camera that captures in the virtual space. The virtual cameracontrol step S253 can be executed by the virtual camera controller 253described above.

The transmission step S254 transmits, to the server device, informationabout the movement operation and the camera operation. The transmissionstep S254 can be executed by the transmitter 254 described above.

The display step S255 displays the character object of the first userand the character object of the second user so as to be movable in thevirtual space. The display step S255 can be executed by the displayportion 255 described above.

The display step S255 displays (i) a video of a first-person viewpointor a third-person viewpoint of the character object of the first user,(ii) a video of the first-person viewpoint or the third-person viewpointof the character object of the second user, or (iii) a plurality ofvideos of (a) the first-person viewpoint or the third-person viewpointof the character object of the first user, and (b) the first-personviewpoint or the third-person viewpoint of the character object of thesecond user.

According to the above configuration, it is possible to provide atechnical improvement that solves or alleviates at least part of theabove-mentioned problems of the conventional technology. Specifically,according to the above configuration, it is possible to improvedistributing users’ distribution motivation, viewing users’ viewingmotivation, and/or users’ motivation to interact with each other.

Finally, a computer program according to an embodiment of thisdisclosure will be described. The computer program is a computer programexecuted by the information processing device (second user terminal 200)described above.

A computer program in this disclosure causes one or more processorsprovided with the information processing system to realize a receptionfunction, a movement operation reception function, a virtual cameracontrol function, a transmission function, and a display function.

The reception function receives, from a server device, information abouta video including a character object of a first user and a characterobject of a second user.

The movement operation reception function accepts the movement operationof the character object of the second user in the virtual space.

The virtual camera control function accepts the camera operation of avirtual camera that captures in the virtual space.

The transmission function transmits, to the server device, informationabout the movement operation and the camera operation.

The display function displays the character object of the first user andthe character object of the second user so as to be movable in thevirtual space.

The display function displays (i) a video of a first-person viewpoint ora third-person viewpoint of the character object of the first user, (ii)a video of the first-person viewpoint or the third-person viewpoint ofthe character object of the second user, or (iii) a plurality of videosof (a) the first-person viewpoint or the third-person viewpoint of thecharacter object of the first user, and (b) the first-person viewpointor the third-person viewpoint of the character object of the seconduser.

The above functions can be realized by a reception circuit 1251, amovement operation reception circuit 1252, a virtual camera controlcircuit 1253, a transmission circuit 1254, and a display circuit 1255that are shown in FIG. 81 . The reception circuit 1251, the movementoperation reception circuit 1252, the virtual camera control circuit1253, the transmission circuit 1254, and the display circuit 1255 arerealized by the receiver 251, the movement operation receiver 252, thevirtual camera controller 253, the transmitter 254, and the displayportion 255 described above, respectively. Details of each component areas described above.

In order to function as the server device or terminal device accordingto the above-described embodiments, an information processing devicesuch as a computer or a cell phone can be preferably used. Such aninformation processing device can be realized by (i) storing a programdescribing the processing content that realizes each function of theserver device or the terminal device according to the embodiment in thestorage portion of an information processing device, and (ii) readingand executing the program by the CPU of the information processingdevice.

Although some embodiments have been described, these embodiments arepresented by way of example only and are not intended to limit the scopeof the disclosure. These novel embodiments can be implemented in variousother forms, and various omissions, substitutions, and modifications canbe made without departing from the content of the disclosure. Theseembodiments and variations thereof are included in the scope and contentof the disclosure as well as in the scope of the claims and theirequivalents.

Additionally, the methods described in the embodiments can be stored ona recording medium, for example, a magnetic disk (a floppy (registeredtrademark) disk, a hard disk, or the like), an optical disk (CD-ROM,DVD, MO, or the like), a semiconductor memory (ROM, RAM, flash memory,or the like), or the like, as programs that can be executed by acomputer, or can be transmitted and distributed by a communicationmedium. A program stored on the medium side also includes a settingprogram for configuring software means (including not only an executionprogram, but also a table and a data structure) to be executed by thecomputer. A computer that realizes this device reads a program recordedon a recording medium, constructs software means by a setting program insome cases, and executes the above-mentioned processing by controllingthe operation by the software means. The recording medium referred to inthis specification is not limited to recording media for distribution,and includes storage media such as a magnetic disk and a semiconductormemory provided in devices connected inside a computer or via a network.Also, for example, it may function as a main storage device, anauxiliary storage device, or a cache memory.

All objects transmitted or received in the information processing systemin this disclosure, such as the above-mentioned “gifts” and “comments”,are electronic “data.”

The above [Summary] section is provided to introduce the variousselected concepts in a simplified form. These various concepts aredescribed afterward in the “Mode to Implement Embodiments” section. Alltrademarks used in this specification are the property of the owners ofthese trademarks. The descriptions in this [Summary] section are notintended to identify the important or indispensable features of thedisclosure described in the scope of the claims, and are not intended tolimit the technical scope of the disclosure described in the scope ofthe claims. The above or other objects, features, and effects of thedisclosure as described in the scope of the claims will become moreapparent from the description in the “Mode to Implement Embodiments”section shown with reference to the attached drawings.

A communication line for realizing the above-mentioned network mayinclude, but is not limited to, a mobile network, a wireless network(for example, RF connection via Bluetooth, Wi-Fi (such as IEEE802.11a/b/n), WiMax, cellular, satellite, laser, or infrared), a fixedtelephone network, the Internet, an intranet, a Local Area Network(LAN), a Wide Area Network (WAN) and/or an Ethernet network.

The above-mentioned memory may include, but is not limited to, acomputer-readable medium, such as a volatile memory (for example,register, cache, random access memory (RAM)), non-volatile memory (forexample, read-only memory (ROM), EEPROM, flash memory), or a storage(for example, a hard disk drive (HDD), a solid state drive (SSD), amagnetic tape, an optical medium). As is easily understood, the term“computer-readable recording medium” may include a medium for datastorage such as a memory and a storage rather than a transmissionmedium, such as a modulated data signal, that is, a transient signal.

This specification is described in the sense of various representativeembodiments that are not intended to be limited in any way. As used inthis application, “one” , “said”, “above-described”, “corresponding”,“the”, “this”, “that” can include the plural unless explicitly indicatedthat it is not the plural. Additionally, the term “include” may mean “tohave” or “to be provided with.” Furthermore, the terms “have beencombined”, “combined”, “have been tied”, “tied”, “have been connected”,or “connected” include mechanical, electrical, magnetic and opticalmethods of combining, connecting, or tying objects to each other, alongwith other methods and do not exclude the presence of intermediateelements between objects thus “having been combined,” “combined,”“having been tied,” “tied,” “having been connected,” or “connected.”

The various systems, methods and devices described in this specificationshould not be construed as being limited in any way. In fact, thisdisclosure is directed to any novel features and aspects of each of thevarious embodiments disclosed, of combinations of these variousembodiments with each other, and of combinations of portions of thesevarious embodiments with each other. The various systems, methods anddevices described in this specification are not limited to anyparticular state, any particular feature, or any combination of suchparticular state and particular feature. The objects and methodsdescribed in this specification do not require that one or morespecified effects exist or that the problem be resolved. Furthermore,various features or embodiments of the various embodiments described inthis specification, or some of such features or embodiments, may be usedin combination with each other.

The operation of some of the various methods disclosed in thisspecification is described, for convenience, in a particular order. Itshould be understood that the description in such a manner encompassesrearranging the order of the above-described operation unless theparticular order is required by the following particular text. Forexample, a plurality of sequentially described operations may berearranged or executed simultaneously in some cases. Further, for thepurpose of simplification, the attached drawings do not show the variousmethods by which the various items and methods described in thisspecification may be used in conjunction with other items and methods.Additionally, this specification may use “generate,” “produce,”“display,” “receive,” “evaluate,” and “distribute.” These terms arehigh-level descriptions of the various actual operations executed. Thevarious actual operations corresponding to these terms may varydepending on the specific implementation and may be readily recognizedby those of skill in the art who have the benefit of the disclosure ofthis specification.

The operation theories, scientific principles, or other theoreticalstatements presented in this specification in connection with thedevices or methods of this disclosure are provided for the purpose ofbetter understanding and are not intended to limit the technical scope.The devices and methods within the attached scope of the claims are notlimited to the devices and methods that operate by the methods describedby such a theory of operation.

Any of the various methods disclosed in this specification areimplemented using a plurality of computer-executable commands stored onone or more computer-readable media (for example, a non-transientcomputer readable storage medium, such as one or more optical mediadisks, a plurality of volatile memory components, or a plurality ofnon-volatile memory components) and can be further executed on acomputer. Here, the plurality of volatile memory components include, forexample, DRAM or SRAM. Further, the plurality of non-volatile memorycomponents include, for example, a hard drive and a solid state drive(SSD). Additionally, the above computer may include any computeravailable on the market, including, for example, a smartphone and othermobile devices having hardware that performs calculations.

Any of a plurality of computer-executable commands for implementing thetechnology disclosed in this specification can be stored any of such onone or more computer-readable media (for example, a non-transientcomputer readable recording medium), along with any data generated andused in the implementation of the various embodiments disclosed in thisspecification. A plurality of commands that can be executed by such acomputer, for example, may be part of a separate software application,or may be part of a software application that is accessed or downloadedvia a web browser or other software application (such as a remotecomputing application). Such software can be run, for example, on asingle local computer (for example, as an agent running on any otherdesired, suitable computer available on the market) or in a networkenvironment (for example, the Internet, a wide area network, a localarea network, a client-server network (such as cloud computingnetworks), or other such networks) using one or more network computers.

For clarity, only certain selected different aspects of the varioussoftware-based implementations are described. Other details well knownin the art are omitted. For example, the technology disclosed in thisspecification is not limited to a particular computer language orprogram. For example, the technology disclosed in this specification canbe executed by software written in C, C++, Java, or any other desired,suitable programming language. Similarly, the technology disclosed inthis specification is not limited to a particular computer or aparticular type of hardware. Specific details of suitable computers andhardware are well known and need not be described in detail in thisspecification.

Furthermore, any of the various embodiments based on such software (forexample, including a plurality of commands that can be executed by acomputer to cause the computer to execute any of the various methodsdisclosed in this specification) may be uploaded, downloaded, oraccessed remotely by suitable communication means. Such suitable meansof communication include, for example, the Internet, the World Wide Web,an intranet, a software application, a cable (including a fiber opticcable), magnetic communication, electromagnetic communication (includingRF communication, microwave communication, and infrared communication),electronic communication, or other such means of communication.

Explanation of Symbols

-   1000 Information processing system-   2000 Information processing system-   3000 Information processing system-   100 First user terminal-   200 Second user terminal-   300 Network-   400 Server device

1. An information processing system comprising: one or more computerprocessors functioning as: a transmitter that transmits, to a seconduser terminal of a second user, information about a video including acharacter object of a first user; a receiver that receives, from thesecond user terminal, a display request for a first object; a firstvideo generator that generates first information for displaying, as afirst video, the character object of the first user and the first objectin a first region in a virtual space; a second video generator thatgenerates second information for causing a second object different fromthe first object to be displayed in a second region in the virtualspace, as a second video, and for displaying the character object of thefirst user so as to be movable in the first region and the secondregion, wherein the second video generator displays the first object anda third object different from the second object in the second region;and an association portion that associates the character object of thefirst user with a fourth object associated with the third object whenthe character object of the first user and the third object have apredetermined relationship, wherein the second video generator displaysthe fourth object in association with the character object of the firstuser when the fourth object is associated with the character object ofthe first user by the association portion.
 2. The information processingsystem according to claim 1, wherein the second video generator displaysa loading image for a predetermined time when the association portionmakes the association.
 3. The information processing system according toclaim 1, wherein the one or more computer processors further functionas: a selection screen generator that generates information fordisplaying, at the second user terminal, a selection screen for makingthe display request for the first object, wherein on the selectionscreen, a plurality of images for making the display request for thefirst object are displayed so as to be selectable, and among the images,an image for making the display request for the first object related tothe fourth object is displayed in a manner different from that of theother images.
 4. The information processing system according to claim 1,wherein the one or more computer processors further function as: adetermination portion that determines whether the fourth object isalready displayed in association with a specified position of thecharacter object of the first user when there is the display request forthe first object to be displayed in association with the specifiedposition of the character object of the first user.
 5. The informationprocessing system according to claim 4, wherein when there is thedisplay request for the first object to be displayed in association withthe specified position of the character object of the first user, andwhen it is determined by the determination portion that the fourthobject is already displayed in association with the specified positionof the character object of the first user, the second video generatordisplays the first object in place of the fourth object, or displaysboth the fourth object and the first object, in association with thespecified position.
 6. The information processing system according toclaim 4, wherein when there is the display request for the first objectto be displayed in association with the specified position of thecharacter object of the first user, and when it is determined by thedetermination portion that the fourth object is already displayed inassociation with the specified position of the character object of thefirst user, the second video generator displays the first object inplace of the fourth object based on an instruction from a first userterminal of the first user.
 7. The information processing systemaccording to claim 1, wherein the second video generator displays thefirst object, the second object, and a fifth object different from thethird object in the second region, and when the character object of thefirst user and the fifth object have a predetermined relationship, theassociation portion releases the association of the fourth objectassociated with the character object of the first user.
 8. Theinformation processing system according to claim 1, wherein when thefourth object is associated with the character object of the first user,the association portion releases association of the fourth objectassociated with the character object of the first user when thecharacter object of the first user and the third object have apredetermined relationship again.
 9. The information processing systemaccording to claim 1, wherein the second video generator changes atleast the second object and the third object to another second objectand another third object based on a predetermined condition.
 10. Theinformation processing system according to claim 9, wherein thepredetermined condition is that a scheduled time has arrived, ascheduled period has elapsed, or a change instruction has been receivedfrom the first user, the second user or another user.
 11. Theinformation processing system according to claim 9, wherein even if thesecond object and the third object are changed to the other secondobject and the other third object, the second video generator generatesthe second information while maintaining the display of the fourthobject that has already been displayed.
 12. The information processingsystem according to claim 11, wherein the one or more computerprocessors further function as: an effect generator that generates apredetermined effect when a combination of the fourth object alreadydisplayed and another fourth object newly displayed corresponding to theother third object has a specified relationship with the other secondobject.
 13. The information processing system according to claim 1,wherein the one or more computer processors further function as: amovement operation receiver that accepts a movement operation of thecharacter object of the first user in the virtual space; and a virtualcamera controller that controls an operation of a virtual camera thatcaptures images in the virtual space.
 14. The information processingsystem according to claim 13, wherein movement of a face of thecharacter object of the first user is generated based on movement of aface of the first user captured by a front camera of the first userterminal of the first user, the first video generator generates themovement of the face of the character object of the first user in aninverted state that is inverted with respect to the movement of the faceof the first user, and the second video generator generates the movementof the face of the character object of the first user in the invertedstate or a non-inverted state according to a positional relationshipbetween the character object of the first user and the virtual camera.15. The information processing system according to claim 1, wherein whenthe character object of the first user moves beyond a movable region,the second video generator causes the character object to reappear fromanother position in the virtual space.
 16. An information processingmethod by one or more computer processors, the method comprising:transmitting, to a second user terminal of a second user, informationabout a video including a character object of a first user; receiving,from the second user terminal, a display request for a first object;generating first information for displaying, as a first video, thecharacter object of the first user and the first object in a firstregion in a virtual space; generating second information for causing (i)a second object different from the first object and (ii) a third object,different from the first object and the second object, to be displayedin a second region in the virtual space, as a second video, and fordisplaying the character object of the first user so as to be movable inthe first region and the second region; associating the character objectof the first user with a fourth object associated with the third objectwhen the character object of the first user and the third object have apredetermined relationship; and displaying the fourth object inassociation with the character object of the first user when the fourthobject is associated with the character object of the first user in theassociation step.
 17. An information processing method by one or morecomputer processors, the method comprising: transmitting, to a serverdevice, information about a video including a character object of afirst user; generating first information for displaying, as a firstvideo, the character object of the first user and a first object, forwhich a display request has been made by a second user terminal, in afirst region in a virtual space; generating second information forcausing (i) a second object different from the first object and (ii) athird object, different from the first object and the second object, tobe displayed in a second region in the virtual space, as a second video,and for displaying the character object of the first user so as to bemovable in the first region and the second region; associating thecharacter object of the first user with a fourth object associated withthe third object when the character object of the first user and thethird object have a predetermined relationship; and displaying thefourth object in association with the character object of the first userwhen the fourth object is associated with the character object of thefirst user in the association step.
 18. A non-transitorycomputer-readable medium storing thereon a computer program that causesone or more computer processors to realize: a transmission function thattransmits, to a server device, information about a video including acharacter object of a first user; a first video generation function thatgenerates first information for displaying, as a first video, thecharacter object of the first user and a first object for which adisplay request has been made by a second user terminal, in a firstregion in a virtual space; a second video generation function thatgenerates second information for causing (i) a second object differentfrom the first object and (ii) a third object, different from the firstobject and the second object, to be displayed in a second region in thevirtual space, as a second video, and for displaying the characterobject of the first user so as to be movable in the first region and thesecond region; and an association function that associates the characterobject of first user with a fourth object associated with the thirdobject when the character object of the first user and the third objecthave a predetermined relationship, wherein when the fourth object isassociated with the character object of the first user by theassociation function, the second video generation function displays thefourth object in association with the character object of the firstuser.
 19. A computer processing method by one or more computerprocessors, the method comprising: receiving, from a server device,information about a video including a character object of a first user;transmitting, to the server device, a display request for a firstobject; displaying, as a first video, the character object of the firstuser and the first object in a first region in a virtual space;displaying, as a second video, a second object different from the firstobject, and a third object different from the first object and thesecond object in a second region in the virtual space; and displayingthe character object of the first user so as to be movable in the firstregion and the second region, wherein when the character object of thefirst user and the third object have a predetermined relationship, thedisplay step for the second video displays the character object of thefirst user in association with a fourth object that is associated withthe third object.
 20. A non-transitory computer-readable medium storingthereon a computer program that causes one or more computer processorsto realize: a reception function that receives, from a server device,information about a video including a character object of a first user;a transmission function that transmits, to the server device, a displayrequest for a first object; and a display function that (i) displays, asa first video, the character object of the first user and the firstobject in a first region in a virtual space, (ii) displays, as a secondvideo, a second object different from the first object, and a thirdobject different from the first object and the second object in a secondregion in the virtual space, and (iii) displays the character object ofthe first user so as to be movable in the first region and the secondregion, wherein when the character object of the first user and thethird object have a predetermined relationship, the display functiondisplays the character object of the first user in association with afourth object that is associated with the third object.